Jun 26 21:53:36 devstack cinder-volume[82101]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 26 21:53:36 devstack cinder-volume[82101]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 21:53:36 devstack cinder-volume[82101]: we strongly recommend against using it for new projects. Jun 26 21:53:36 devstack cinder-volume[82101]: If you are already using Eventlet, we recommend migrating to a different Jun 26 21:53:36 devstack cinder-volume[82101]: framework. For more detail see Jun 26 21:53:36 devstack cinder-volume[82101]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 21:53:36 devstack cinder-volume[82101]: import eventlet # noqa Jun 26 21:53:38 devstack cinder-volume[82101]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 21:53:38 devstack cinder-volume[82101]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 21:53:38 devstack cinder-volume[82101]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 21:53:39 devstack cinder-volume[82101]: INFO dbcounter [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Registered counter for database cinder Jun 26 21:53:39 devstack cinder-volume[82101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:53:39 devstack cinder-volume[82101]: DEBUG dbcounter [-] [82101] Writer thread running {{(pid=82101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 26 21:53:40 devstack cinder-volume[82101]: INFO cinder.rpc [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 26 21:53:40 devstack cinder-volume[82101]: INFO cinder.rpc [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 26 21:53:40 devstack cinder-volume[82101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:53:40 devstack cinder-volume[82101]: INFO cinder.volume.manager [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Determined volume DB was empty at startup. Jun 26 21:53:40 devstack cinder-volume[82101]: DEBUG cinder.volume.manager [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82101) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 26 21:53:40 devstack cinder-volume[82101]: INFO cinder.volume.manager [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 26 21:53:40 devstack cinder-volume[82101]: WARNING stevedore.named [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 26 21:53:40 devstack cinder-volume[82101]: WARNING castellan.key_manager [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 26 21:53:40 devstack cinder-volume[82101]: WARNING cinder.keymgr.conf_key_mgr [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 26 21:53:40 devstack cinder-volume[82101]: DEBUG cinder.volume.drivers.lvm [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82101) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 26 21:53:40 devstack cinder-volume[82101]: DEBUG oslo_concurrency.processutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:40 devstack cinder-volume[82101]: DEBUG oslo_concurrency.processutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] CMD "cinder-rtstool verify" returned: 0 in 0.469s {{(pid=82101) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:40 devstack cinder-volume[82101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:53:40 devstack cinder-volume[82101]: INFO cinder.rpc [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 26 21:53:40 devstack cinder-volume[82101]: INFO cinder.rpc [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 26 21:53:40 devstack cinder-volume[82101]: WARNING stevedore.named [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 26 21:53:40 devstack cinder-volume[82101]: WARNING castellan.key_manager [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 26 21:53:40 devstack cinder-volume[82101]: INFO cinder.volume.manager [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 26 21:53:40 devstack cinder-volume[82101]: DEBUG oslo_db.sqlalchemy.engines [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82101) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:53:41 devstack cinder-volume[82101]: INFO oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Starting 1 workers Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Started child 82280 {{(pid=82101) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Full set of CONF: {{(pid=82101) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] ******************************************************************************** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Configuration options gathered from: {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] ================================================================================ {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] allow_availability_zone_fallback = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] allow_compression_on_image_upload = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82280]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] allowed_direct_url_schemes = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] api_rate_limit = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] auth_strategy = keystone {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] az_cache_duration = 3600 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_availability_zone = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_host = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_stats_polling_interval = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backup_api_class = cinder.backup.api.API {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backup_name_template = backup-%s {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backup_use_same_host = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backup_use_temp_snapshot = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] chap_password = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] chap_username = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_internal_tenant_project_id = 64bd6284f7e044218b6a360fc48cfb8d {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_internal_tenant_user_id = d6edbf63b5364e4db09ab97bf1ee5d70 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cloned_volume_same_az = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cluster = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] compression_format = gzip {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] compute_api_class = cinder.compute.nova.API {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] config_dir = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] config_source = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] control_exchange = openstack {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] debug = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] default_availability_zone = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] default_group_type = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] default_volume_type = lvmdriver-1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] disk_geometry = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] driver_client_cert = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] driver_client_cert_key = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] driver_data_namespace = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] driver_ssl_cert_path = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] driver_ssl_cert_verify = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] driver_use_ssl = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] enable_force_upload = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] enable_new_services = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] enable_unsupported_driver = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] enforce_multipath_for_image_xfer = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] filter_function = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_api_insecure = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_api_ssl_compression = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_ca_certificates_file = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_catalog_info = image:glance:publicURL {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_num_retries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance_request_timeout = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] goodness_function = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] graceful_shutdown_timeout = 5 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] group_api_class = cinder.group.api.API {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] host = devstack {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_compress_on_upload = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_conversion_address_space_limit = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_conversion_cpu_limit = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82280]: INFO cinder.volume.manager [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_conversion_disable = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_upload_use_cinder_backend = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_upload_use_internal_tenant = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_volume_cache_enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_volume_cache_max_count = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] image_volume_cache_max_size_gb = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] init_host_max_objects_retrieval = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] instance_format = [instance: %(uuid)s] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] iscsi_target_flags = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] iscsi_write_cache = on {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] iser_helper = tgtadm {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] iser_ip_address = 192.168.122.249 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] iser_port = 3260 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_color = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_config_append = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_dir = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_file = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_options = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_rotate_interval = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_rotate_interval_type = days {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] log_rotation_type = none {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] max_age = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] max_logfile_count = 30 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] max_logfile_size_mb = 200 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] max_over_subscription_ratio = 20.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] message_reap_interval = 86400 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] message_ttl = 2592000 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] migration_create_volume_timeout_secs = 300 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] monkey_patch = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] monkey_patch_modules = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] my_ip = 192.168.122.249 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] no_snapshot_gb_quota = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] num_iser_scan_tries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] num_shell_tries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] num_volume_device_scan_tries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] nvmeof_conn_info_version = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] nvmet_ns_id = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] nvmet_port_id = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] osapi_max_limit = 1000 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] osapi_volume_ext_list = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] osapi_volume_listen_port = 8776 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] osapi_volume_use_ssl = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] osapi_volume_workers = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] per_volume_size_limit = -1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] periodic_fuzzy_delay = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] periodic_interval = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] public_endpoint = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] publish_errors = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] quota_backup_gigabytes = 1000 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] quota_backups = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] quota_gigabytes = 1000 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] quota_groups = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] quota_snapshots = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] quota_volumes = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] rate_limit_burst = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] rate_limit_except_level = CRITICAL {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] rate_limit_interval = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] reinit_driver_count = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] replication_device = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] report_discard_supported = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] report_interval = 120 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack sudo[82285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] reservation_clean_interval = 86400 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] reservation_expire = 86400 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] reserved_image_namespaces = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] reserved_percentage = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack sudo[82285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] rpc_response_timeout = 120 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] run_external_periodic_tasks = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] scst_target_driver = iscsi {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] scst_target_iqn_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_down_time = 720 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] shell_completion = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] snapshot_name_template = snapshot-%s {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] snapshot_same_host = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] split_loggers = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] state_path = /opt/stack/data/cinder {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] storage_availability_zone = nova {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] storage_protocol = iSCSI {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] syslog_log_facility = LOG_USER {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] target_helper = lioadm {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] target_ip_address = 192.168.122.249 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] target_port = 3260 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] target_protocol = iscsi {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] target_secondary_ip_addresses = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] trace_flags = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] transport_url = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] until_refresh = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] use_chap_auth = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] use_default_quota_class = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] use_journal = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] use_json = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] use_multipath_for_image_xfer = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] use_stderr = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] use_syslog = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] verify_glance_signatures = enabled {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_api_class = cinder.volume.api.API {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_backend_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_clear = zero {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_clear_ionice = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_clear_size = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_copy_bps_limit = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_dd_blocksize = 1M {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_name_template = volume-%s {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_service_inithost_offload = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volume_usage_audit_period = month {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] zoning_mode = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_concurrency.disable_process_locking = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.auth_section = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.auth_type = password {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.auth_version = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.cache = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.include_service_catalog = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.insecure = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.interface = public {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_password = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcache_username = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.region_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.service_type = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.backend = dogpile.cache.null {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.backend_argument = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.backend_expiration_time = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.config_prefix = cache.oslo {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.debug_cache_backend = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.enable_retry_client = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.enable_socket_keepalive = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.expiration_time = 600 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.hashclient_retry_attempts = 2 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.memcache_dead_retry = 300 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.memcache_pool_maxsize = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.memcache_sasl_enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.password = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.proxies = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.redis_db = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.redis_server = localhost:6379 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.retry_attempts = 2 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.retry_delay = 0.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.socket_keepalive_count = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.socket_keepalive_idle = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.socket_keepalive_interval = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.socket_timeout = 1.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.tls_allowed_ciphers = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.tls_cafile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.tls_certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.tls_enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.tls_keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cache.username = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] coordination.backend_url = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.asyncio_connection = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.asyncio_slave_connection = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.backend = sqlalchemy {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.connection = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.connection_debug = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.connection_parameters = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.connection_recycle_time = 3600 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.connection_trace = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.db_inc_retry_interval = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.db_max_retries = 20 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.db_max_retry_interval = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.db_retry_interval = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.max_overflow = 50 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.max_pool_size = 5 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.max_retries = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.mysql_wsrep_sync_wait = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.pool_timeout = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.retry_interval = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.slave_connection = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.sqlite_synchronous = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.synchronous_reader = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] database.use_db_reconnect = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.connection_string = messaging:// {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.es_doc_type = notification {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.es_scroll_size = 10000 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.es_scroll_time = 2m {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.filter_error_trace = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.hmac_keys = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.sentinel_service_name = mymaster {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.socket_timeout = 0.1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.trace_requests = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler.trace_sqlalchemy = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler_jaeger.process_tags = {} {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler_jaeger.service_name_prefix = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] profiler_otlp.service_name_prefix = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.enforce_new_defaults = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: WARNING oslo_config.cfg [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.enforce_scope = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.policy_default_rule = default {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.policy_file = policy.yaml {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] privsep_osbrick.group = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] privsep_osbrick.helper_command = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] privsep_osbrick.user = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_sys_admin.group = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_sys_admin.helper_command = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] cinder_sys_admin.user = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.auth_section = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.auth_type = password {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.cafile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.collect_timing = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.insecure = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.send_service_user_token = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.split_loggers = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] service_user.timeout = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.auth_section = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.auth_type = password {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.collect_timing = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.insecure = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.region_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.split_loggers = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] glance.timeout = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.backend_availability_zone = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.chap_password = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.chap_username = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.disk_geometry = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.driver_client_cert = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.driver_client_cert_key = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.driver_data_namespace = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.driver_use_ssl = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.extra_capabilities = {} {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.filter_function = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.goodness_function = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.iscsi_target_flags = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.iscsi_write_cache = on {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.iser_helper = tgtadm {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.iser_port = 3260 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.lvm_share_target = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.lvm_type = auto {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.num_shell_tries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.replication_device = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.report_discard_supported = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.reserved_percentage = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.target_helper = tgtadm {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.target_port = 3260 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.target_protocol = iscsi {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.trace_flags = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.unique_fqdn_network = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.use_chap_auth = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_backend_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_clear = zero {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_clear_ionice = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_clear_size = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_reports.file_event_handler = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_reports.log_dir = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.backend_host = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.chap_password = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.chap_username = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.disk_geometry = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.driver_client_cert = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.extra_capabilities = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.filter_function = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.goodness_function = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.iser_helper = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.iser_ip_address = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.iser_port = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.lvm_share_target = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.lvm_type = auto {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.num_shell_tries = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.replication_device = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.report_discard_supported = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.reserved_percentage = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.scst_target_driver = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.storage_protocol = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.target_helper = lioadm {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.target_ip_address = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.target_port = 3260 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.trace_flags = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.use_chap_auth = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_clear = zero {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_clear_size = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] lvmdriver-1.volumes_dir = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.ssl = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_notifications.driver = [] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_notifications.retry = -1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] key_manager.fixed_key = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.barbican_api_version = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.barbican_endpoint = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.barbican_endpoint_type = public {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.barbican_region_name = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.cafile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.collect_timing = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.insecure = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.number_of_retries = 60 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.retry_delay = 1 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.send_service_user_token = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.split_loggers = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.timeout = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.verify_ssl = True {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican.verify_ssl_path = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.auth_section = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.auth_type = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.cafile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.certfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.collect_timing = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.insecure = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.keyfile = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.split_loggers = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] barbican_service_user.timeout = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.approle_role_id = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.approle_secret_id = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.kv_mountpoint = secret {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.kv_path = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.kv_version = 2 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.namespace = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.root_token_id = **** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.ssl_ca_crt_file = None {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.timeout = 60.0 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.use_ssl = False {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:53:41 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] ******************************************************************************** {{(pid=82101) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 26 21:53:41 devstack sudo[82285]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:41 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:41 devstack sudo[82362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:41 devstack sudo[82362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:42 devstack sudo[82362]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:42 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.741s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:42 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 21:53:42 devstack cinder-volume[82280]: INFO cinder.brick.local_dev.lvm [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 26 21:53:42 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:42 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:42 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:42 devstack sudo[82650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:53:42 devstack sudo[82650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:43 devstack sudo[82650]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:43 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.804s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:43 devstack cinder-volume[82280]: DEBUG cinder.brick.local_dev.lvm [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82280) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 26 21:53:43 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:43 devstack sudo[82851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:43 devstack sudo[82851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:44 devstack sudo[82851]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:44 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.240s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:44 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:44 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:44 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:44 devstack sudo[83061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:44 devstack sudo[83061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:45 devstack sudo[83061]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:45 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.641s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:45 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:45 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:45 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:45 devstack sudo[83066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 26 21:53:45 devstack sudo[83066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:45 devstack sudo[83066]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:46 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.669s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:46 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:46 devstack sudo[83071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:53:46 devstack sudo[83071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:46 devstack sudo[83071]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:46 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.910s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:46 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:46 devstack sudo[83082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:53:46 devstack sudo[83082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:47 devstack sudo[83082]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:47 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:47 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:47 devstack sudo[83087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:53:47 devstack sudo[83087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:48 devstack sudo[83087]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:48 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.004s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:48 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:48 devstack sudo[83094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:48 devstack sudo[83094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:49 devstack sudo[83094]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:49 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.665s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:49 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:49 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:49 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:49 devstack sudo[83101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:49 devstack sudo[83101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:50 devstack sudo[83101]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:50 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.733s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:50 devstack cinder-volume[82280]: INFO cinder.volume.drivers.lvm [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 26 21:53:50 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:50 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:50 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:50 devstack sudo[83111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:50 devstack sudo[83111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:50 devstack sudo[83111]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:50 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.677s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:50 devstack cinder-volume[82280]: DEBUG cinder.volume.drivers.lvm [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Updating volume stats {{(pid=82280) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 26 21:53:50 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:50 devstack sudo[83230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:53:50 devstack sudo[83230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:50 devstack cinder-volume[82101]: DEBUG dbcounter [-] [82101] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82101) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:53:51 devstack sudo[83230]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:51 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:51 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:51 devstack sudo[83395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:53:51 devstack sudo[83395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:52 devstack sudo[83395]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:52 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:52 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:52 devstack sudo[83409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:52 devstack sudo[83409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:52 devstack sudo[83409]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:52 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:52 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:52 devstack sudo[83412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:53:52 devstack sudo[83412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:53 devstack sudo[83412]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:53 devstack cinder-volume[82280]: INFO cinder.volume.driver [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Driver hasn't implemented _init_vendor_properties() Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG cinder.volume.driver [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82280) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG oslo_db.sqlalchemy.engines [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82280) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG dbcounter [-] [82280] Writer thread running {{(pid=82280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG cinder.db.api [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Building query based on filter {{(pid=82280) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG cinder.image.image_utils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82280) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 26 21:53:53 devstack cinder-volume[82280]: INFO cinder.keymgr.migration [None req-7e9e3215-bdc1-4049-a524-bf8ef5fad6e3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG cinder.volume.drivers.lvm [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Updating volume stats {{(pid=82280) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 26 21:53:53 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:53 devstack sudo[83416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:53:53 devstack sudo[83416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:54 devstack sudo[83416]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:54 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:54 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:54 devstack sudo[83421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:53:54 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:54 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:54 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:54 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:54 devstack sudo[83427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:54 devstack sudo[83427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:55 devstack sudo[83427]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:55 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.640s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:55 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:55 devstack sudo[83430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:53:55 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:56 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:56 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.715s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:56 devstack cinder-volume[82280]: DEBUG cinder.manager [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Notifying Schedulers of capabilities ... {{(pid=82280) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:53:56 devstack cinder-volume[82280]: INFO cinder.volume.manager [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Driver initialization completed successfully. Jun 26 21:53:56 devstack cinder-volume[82280]: INFO cinder.manager [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Initiating service 2 cleanup Jun 26 21:53:56 devstack cinder-volume[82280]: INFO cinder.manager [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Service 2 cleanup completed. Jun 26 21:53:56 devstack cinder-volume[82280]: DEBUG cinder.service [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Creating RPC server for service cinder-volume {{(pid=82280) start /opt/stack/cinder/cinder/service.py:231}} Jun 26 21:53:56 devstack cinder-volume[82280]: DEBUG cinder.service [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82280) start /opt/stack/cinder/cinder/service.py:237}} Jun 26 21:53:56 devstack cinder-volume[82280]: INFO cinder.volume.manager [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 26 21:53:56 devstack cinder-volume[82280]: DEBUG cinder.volume.drivers.lvm [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Updating volume stats {{(pid=82280) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 26 21:53:56 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:56 devstack sudo[83435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:53:56 devstack sudo[83435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:57 devstack sudo[83435]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:57 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.757s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:57 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:57 devstack sudo[83439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:53:57 devstack sudo[83439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:57 devstack sudo[83439]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:57 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:57 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:57 devstack sudo[83445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:53:57 devstack sudo[83445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:58 devstack sudo[83445]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:58 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.714s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:58 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:53:58 devstack sudo[83502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:53:58 devstack sudo[83502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:53:59 devstack sudo[83502]: pam_unix(sudo:session): session closed for user root Jun 26 21:53:59 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:53:59 devstack cinder-volume[82280]: INFO cinder.volume.manager [None req-dd0593d2-6ac7-4a48-9e69-7b539de0550e None None] Driver post RPC initialization completed successfully. Jun 26 21:54:09 devstack cinder-volume[82280]: DEBUG dbcounter [-] [82280] Writing DB stats cinder:SELECT=4 {{(pid=82280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:54:09 devstack cinder-volume[82280]: DEBUG dbcounter [-] [82280] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:54:34 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager._thread_info {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:54:34 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread count: 6 {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 21:54:34 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread info: [<_MainThread(MainThread, started 123330342781056)>, , , , , ] {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 21:55:34 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:55:34 devstack cinder-volume[82280]: DEBUG cinder.volume.drivers.lvm [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Updating volume stats {{(pid=82280) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 26 21:55:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:55:34 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:55:34 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:55:34 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Jun 26 21:55:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:55:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:55:34 devstack sudo[88728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:55:34 devstack sudo[88728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:55:35 devstack sudo[88728]: pam_unix(sudo:session): session closed for user root Jun 26 21:55:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:55:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:55:35 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:55:35 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:55:36 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Jun 26 21:55:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.670s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:55:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:55:36 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:55:36 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:55:36 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Jun 26 21:55:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:55:36 devstack cinder-volume[82280]: DEBUG cinder.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Notifying Schedulers of capabilities ... {{(pid=82280) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:55:36 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager._thread_info {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:55:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread count: 6 {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 21:55:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread info: [<_MainThread(MainThread, started 123330342781056)>, , , , , ] {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 21:56:09 devstack cinder-volume[82280]: DEBUG dbcounter [-] [82280] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:56:34 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:56:34 devstack cinder-volume[82280]: DEBUG cinder.volume.drivers.lvm [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Updating volume stats {{(pid=82280) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 26 21:56:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:56:34 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:56:34 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:56:34 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Jun 26 21:56:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:56:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:56:34 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:56:34 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:56:35 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Jun 26 21:56:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:56:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:56:35 devstack sudo[89159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:56:35 devstack sudo[89159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:56:36 devstack sudo[89159]: pam_unix(sudo:session): session closed for user root Jun 26 21:56:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.621s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:56:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:56:36 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:56:36 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:56:36 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Jun 26 21:56:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:56:36 devstack cinder-volume[82280]: DEBUG cinder.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Notifying Schedulers of capabilities ... {{(pid=82280) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:56:36 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager._thread_info {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:56:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread count: 6 {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 21:56:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread info: [<_MainThread(MainThread, started 123330342781056)>, , , , , ] {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 21:57:34 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:57:34 devstack cinder-volume[82280]: DEBUG cinder.volume.drivers.lvm [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Updating volume stats {{(pid=82280) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 26 21:57:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:57:34 devstack sudo[91248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:57:34 devstack sudo[91248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:57:34 devstack sudo[91248]: pam_unix(sudo:session): session closed for user root Jun 26 21:57:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:57:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:57:34 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:57:34 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:57:35 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Jun 26 21:57:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:57:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:57:35 devstack sudo[91288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:57:35 devstack sudo[91288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:57:36 devstack sudo[91288]: pam_unix(sudo:session): session closed for user root Jun 26 21:57:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.631s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:57:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:57:36 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:57:36 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:57:36 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Jun 26 21:57:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:57:36 devstack cinder-volume[82280]: DEBUG cinder.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Notifying Schedulers of capabilities ... {{(pid=82280) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:57:36 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager._thread_info {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:57:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread count: 6 {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 21:57:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread info: [<_MainThread(MainThread, started 123330342781056)>, , , , , ] {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 21:58:09 devstack cinder-volume[82280]: DEBUG dbcounter [-] [82280] Writing DB stats cinder:SELECT=1 {{(pid=82280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:58:09 devstack cinder-volume[82280]: DEBUG dbcounter [-] [82280] Writing DB stats cinder:UPDATE=1 {{(pid=82280) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:58:34 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:58:34 devstack cinder-volume[82280]: DEBUG cinder.volume.drivers.lvm [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Updating volume stats {{(pid=82280) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 26 21:58:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:34 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 26 21:58:34 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:34 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:34 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:34 devstack sudo[92476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:58:34 devstack sudo[92476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:35 devstack sudo[92476]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.655s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:35 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:35 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 26 21:58:35 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:36 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:36 devstack sudo[92494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 26 21:58:36 devstack sudo[92494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:36 devstack sudo[92494]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:36 devstack cinder-volume[82280]: DEBUG oslo_concurrency.processutils [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=82280) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:36 devstack cinder-volume[82280]: DEBUG cinder.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Notifying Schedulers of capabilities ... {{(pid=82280) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:58:36 devstack cinder-volume[82280]: DEBUG oslo_service.periodic_task [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] Running periodic task VolumeManager._thread_info {{(pid=82280) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:58:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread count: 6 {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 21:58:36 devstack cinder-volume[82280]: DEBUG cinder.volume.manager [None req-1752d9c2-9886-4f2d-9ed0-ea8cf25ab49e None None] thread info: [<_MainThread(MainThread, started 123330342781056)>, , , , , ] {{(pid=82280) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 21:58:42 devstack cinder-volume[82101]: INFO oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Caught SIGTERM, stopping children Jun 26 21:58:42 devstack cinder-volume[82101]: DEBUG oslo_concurrency.lockutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Acquiring lock "singleton_lock" {{(pid=82101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 21:58:42 devstack cinder-volume[82101]: DEBUG oslo_concurrency.lockutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Acquired lock "singleton_lock" {{(pid=82101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 21:58:42 devstack cinder-volume[82101]: DEBUG oslo_concurrency.lockutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Releasing lock "singleton_lock" {{(pid=82101) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 21:58:42 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Stop services. {{(pid=82101) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 26 21:58:42 devstack cinder-volume[82101]: DEBUG oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Killing children. {{(pid=82101) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 26 21:58:42 devstack cinder-volume[82101]: INFO oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Waiting on 1 children to exit Jun 26 21:58:46 devstack cinder-volume[82280]: DEBUG oslo_concurrency.lockutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Acquiring lock "singleton_lock" {{(pid=82280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 21:58:46 devstack cinder-volume[82280]: DEBUG oslo_concurrency.lockutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Acquired lock "singleton_lock" {{(pid=82280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 21:58:46 devstack cinder-volume[82280]: DEBUG oslo_concurrency.lockutils [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Releasing lock "singleton_lock" {{(pid=82280) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 21:58:46 devstack cinder-volume[82280]: WARNING amqp [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 26 21:58:46 devstack cinder-volume[82280]: WARNING amqp [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 26 21:58:46 devstack cinder-volume[82101]: INFO oslo_service.backend._eventlet.service [None req-5d77f226-9ff4-4ba9-aab9-76985e993111 None None] Child 82280 exited with status 0 Jun 26 21:58:46 devstack cinder-volume[92797]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 26 21:58:46 devstack cinder-volume[92797]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 21:58:46 devstack cinder-volume[92797]: we strongly recommend against using it for new projects. Jun 26 21:58:46 devstack cinder-volume[92797]: If you are already using Eventlet, we recommend migrating to a different Jun 26 21:58:46 devstack cinder-volume[92797]: framework. For more detail see Jun 26 21:58:46 devstack cinder-volume[92797]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 21:58:46 devstack cinder-volume[92797]: import eventlet # noqa Jun 26 21:58:48 devstack cinder-volume[92797]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 21:58:48 devstack cinder-volume[92797]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 21:58:48 devstack cinder-volume[92797]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 21:58:49 devstack cinder-volume[92797]: INFO dbcounter [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Registered counter for database cinder Jun 26 21:58:49 devstack cinder-volume[92797]: DEBUG oslo_db.sqlalchemy.engines [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:58:49 devstack cinder-volume[92797]: DEBUG dbcounter [-] [92797] Writer thread running {{(pid=92797) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 26 21:58:49 devstack cinder-volume[92797]: INFO cinder.rpc [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 26 21:58:49 devstack cinder-volume[92797]: INFO cinder.rpc [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 26 21:58:49 devstack cinder-volume[92797]: DEBUG oslo_db.sqlalchemy.engines [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:58:49 devstack cinder-volume[92797]: INFO cinder.volume.manager [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Determined volume DB was empty at startup. Jun 26 21:58:49 devstack cinder-volume[92797]: DEBUG cinder.volume.manager [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92797) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 26 21:58:49 devstack cinder-volume[92797]: INFO cinder.volume.manager [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 26 21:58:49 devstack cinder-volume[92797]: WARNING stevedore.named [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 26 21:58:49 devstack cinder-volume[92797]: WARNING castellan.key_manager [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 26 21:58:49 devstack cinder-volume[92797]: WARNING cinder.keymgr.conf_key_mgr [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 26 21:58:49 devstack cinder-volume[92797]: INFO cinder.volume.manager [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_db.sqlalchemy.engines [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92797) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:58:50 devstack cinder-volume[92797]: INFO oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Starting 1 workers Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Started child 93012 {{(pid=92797) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Full set of CONF: {{(pid=92797) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] ******************************************************************************** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Configuration options gathered from: {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] ================================================================================ {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] allow_availability_zone_fallback = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] allow_compression_on_image_upload = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] allowed_direct_url_schemes = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] api_rate_limit = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] auth_strategy = keystone {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_availability_zone = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_host = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_stats_polling_interval = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backup_api_class = cinder.backup.api.API {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backup_name_template = backup-%s {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backup_use_same_host = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backup_use_temp_snapshot = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] chap_password = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] chap_username = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_internal_tenant_project_id = 64bd6284f7e044218b6a360fc48cfb8d {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_internal_tenant_user_id = d6edbf63b5364e4db09ab97bf1ee5d70 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cluster = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] compression_format = gzip {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] compute_api_class = cinder.compute.nova.API {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] config_dir = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] config_source = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] control_exchange = openstack {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] debug = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] default_availability_zone = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] default_group_type = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] default_volume_type = QuobyteHD {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] disk_geometry = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] driver_client_cert = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] driver_client_cert_key = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] driver_data_namespace = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] driver_ssl_cert_path = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] driver_ssl_cert_verify = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] driver_use_ssl = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] enable_new_services = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] enable_unsupported_driver = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] enabled_backends = ['QuobyteHD'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] enforce_multipath_for_image_xfer = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] filter_function = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_api_insecure = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_api_ssl_compression = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_ca_certificates_file = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_catalog_info = image:glance:publicURL {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[93012]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_num_retries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance_request_timeout = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] goodness_function = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] graceful_shutdown_timeout = 5 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] group_api_class = cinder.group.api.API {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] host = devstack {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_compress_on_upload = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_conversion_address_space_limit = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_conversion_cpu_limit = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_conversion_disable = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_upload_use_cinder_backend = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_upload_use_internal_tenant = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_volume_cache_enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_volume_cache_max_count = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] image_volume_cache_max_size_gb = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] init_host_max_objects_retrieval = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] instance_format = [instance: %(uuid)s] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] iscsi_target_flags = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] iscsi_write_cache = on {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] iser_helper = tgtadm {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] iser_ip_address = 192.168.122.249 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] iser_port = 3260 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_color = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_config_append = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_dir = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_file = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_options = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_rotate_interval = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_rotate_interval_type = days {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] log_rotation_type = none {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] max_age = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] max_logfile_count = 30 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] max_logfile_size_mb = 200 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] max_over_subscription_ratio = 20.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] message_reap_interval = 86400 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] message_ttl = 2592000 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] migration_create_volume_timeout_secs = 300 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] monkey_patch = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] monkey_patch_modules = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] my_ip = 192.168.122.249 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] no_snapshot_gb_quota = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] num_iser_scan_tries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] num_shell_tries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] num_volume_device_scan_tries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] nvmeof_conn_info_version = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] nvmet_ns_id = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] nvmet_port_id = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] osapi_max_limit = 1000 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] osapi_volume_ext_list = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] osapi_volume_listen = 0.0.0.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] osapi_volume_listen_port = 8776 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] osapi_volume_use_ssl = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] osapi_volume_workers = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] per_volume_size_limit = -1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] periodic_fuzzy_delay = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] periodic_interval = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] project_id_regex = [0-9a-f\-]+ {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] public_endpoint = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] publish_errors = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] quota_backup_gigabytes = 1000 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] quota_backups = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] quota_gigabytes = 1000 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] quota_groups = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] quota_snapshots = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] quota_volumes = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] rate_limit_burst = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] rate_limit_except_level = CRITICAL {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] rate_limit_interval = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] reinit_driver_count = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] replication_device = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] report_discard_supported = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] report_interval = 120 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] reservation_clean_interval = 86400 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] reservation_expire = 86400 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] reserved_image_namespaces = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] reserved_percentage = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] rpc_response_timeout = 120 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] run_external_periodic_tasks = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] scst_target_driver = iscsi {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] scst_target_iqn_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_down_time = 720 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] shell_completion = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] snapshot_name_template = snapshot-%s {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] split_loggers = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] state_path = /opt/stack/data/cinder {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] storage_availability_zone = nova {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] storage_protocol = iSCSI {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] syslog_log_facility = LOG_USER {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] target_helper = lioadm {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] target_ip_address = 192.168.122.249 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] target_port = 3260 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] target_protocol = iscsi {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] target_secondary_ip_addresses = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] trace_flags = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] transfer_api_class = cinder.transfer.api.API {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] transport_url = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] until_refresh = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] use_chap_auth = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] use_default_quota_class = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] use_journal = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] use_json = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] use_multipath_for_image_xfer = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] use_stderr = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] use_syslog = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] verify_glance_signatures = enabled {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_api_class = cinder.volume.api.API {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_backend_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_clear = zero {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_clear_ionice = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_clear_size = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_copy_bps_limit = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_dd_blocksize = 1M {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_name_template = volume-%s {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_service_inithost_offload = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volume_usage_audit_period = month {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] zoning_mode = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_concurrency.disable_process_locking = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.auth_section = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.auth_type = password {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.auth_version = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.cache = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.delay_auth_decision = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.http_connect_timeout = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.include_service_catalog = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.insecure = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.interface = public {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_password = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcache_username = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.region_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.service_token_roles_required = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.service_type = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.token_cache_time = 300 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.backend = dogpile.cache.null {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.backend_argument = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.backend_expiration_time = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.config_prefix = cache.oslo {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.debug_cache_backend = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.enable_retry_client = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.enable_socket_keepalive = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.expiration_time = 600 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.hashclient_retry_attempts = 2 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.memcache_dead_retry = 300 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.memcache_pool_maxsize = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.memcache_sasl_enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.password = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.proxies = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.redis_db = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.redis_sentinel_service_name = mymaster {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.redis_server = localhost:6379 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.retry_attempts = 2 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.retry_delay = 0.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.socket_keepalive_count = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.socket_keepalive_idle = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.socket_keepalive_interval = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.socket_timeout = 1.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.tls_allowed_ciphers = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.tls_cafile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.tls_certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.tls_enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.tls_keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cache.username = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] coordination.backend_url = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.asyncio_connection = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.asyncio_slave_connection = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.backend = sqlalchemy {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.connection = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.connection_debug = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.connection_parameters = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.connection_recycle_time = 3600 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.connection_trace = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.db_inc_retry_interval = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.db_max_retries = 20 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.db_max_retry_interval = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.db_retry_interval = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.max_overflow = 50 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.max_pool_size = 5 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.max_retries = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.mysql_wsrep_sync_wait = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.pool_timeout = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.retry_interval = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.slave_connection = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.sqlite_synchronous = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.synchronous_reader = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] database.use_db_reconnect = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[93012]: INFO cinder.volume.manager [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.remotefs [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93012) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.connection_string = messaging:// {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.es_doc_type = notification {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.es_scroll_size = 10000 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.es_scroll_time = 2m {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.filter_error_trace = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.hmac_keys = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.sentinel_service_name = mymaster {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.socket_timeout = 0.1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.trace_requests = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler.trace_sqlalchemy = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler_jaeger.process_tags = {} {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler_jaeger.service_name_prefix = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] profiler_otlp.service_name_prefix = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.enforce_new_defaults = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: WARNING oslo_config.cfg [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.enforce_scope = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.policy_default_rule = default {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.policy_file = policy.yaml {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_policy.remote_timeout = 60.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] privsep_osbrick.group = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] privsep_osbrick.helper_command = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] privsep_osbrick.user = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_sys_admin.group = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_sys_admin.helper_command = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] cinder_sys_admin.user = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.auth_section = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.auth_type = password {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.cafile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.collect_timing = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.insecure = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.send_service_user_token = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.split_loggers = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] service_user.timeout = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.auth_section = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.auth_type = password {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.collect_timing = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.insecure = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.region_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.split_loggers = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] glance.timeout = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.backend_availability_zone = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.chap_password = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.chap_username = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.disk_geometry = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.driver_client_cert = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.driver_client_cert_key = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.driver_data_namespace = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.driver_use_ssl = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.enable_unsupported_driver = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.extra_capabilities = {} {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.filter_function = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.goodness_function = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.iscsi_target_flags = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.iscsi_write_cache = on {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.iser_helper = tgtadm {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.iser_port = 3260 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_host = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_login = admin {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_mount_options = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_password = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_private_key = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_share_path = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_ssh_port = 22 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.num_shell_tries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.nvmet_port_id = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.quobyte_client_cfg = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.quobyte_volume_url = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.replication_device = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.report_discard_supported = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.reserved_percentage = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.scst_target_driver = iscsi {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.scst_target_iqn_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.storage_protocol = iSCSI {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.target_helper = tgtadm {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.target_port = 3260 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.target_protocol = iscsi {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.trace_flags = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.unique_fqdn_network = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.use_chap_auth = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_backend_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_clear = zero {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_clear_ionice = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_clear_size = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_reports.file_event_handler = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_reports.log_dir = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.backend_availability_zone = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.backend_host = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.chap_password = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.chap_username = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.chiscsi_conf = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.disk_geometry = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.driver_client_cert = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.driver_client_cert_key = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.driver_data_namespace = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.driver_use_ssl = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.extra_capabilities = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.filter_function = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.goodness_function = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.iscsi_target_flags = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.iscsi_write_cache = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.iser_helper = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.iser_ip_address = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.iser_port = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.iser_target_prefix = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93012) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 26 21:58:50 devstack cinder-volume[93012]: WARNING cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 26 21:58:50 devstack cinder-volume[93012]: WARNING cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Running cmd (subprocess): mount.quobyte {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_host = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_login = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_mount_options = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_password = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_private_key = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_share_path = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_ssh_port = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.num_shell_tries = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nvmet_ns_id = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.nvmet_port_id = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.replication_device = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.report_discard_supported = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.reserved_percentage = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.scst_target_driver = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.storage_protocol = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.target_helper = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.target_ip_address = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.target_port = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.target_prefix = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.target_protocol = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.trace_flags = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.unique_fqdn_network = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.use_chap_auth = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_clear = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_clear_ionice = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_clear_size = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] QuobyteHD.volumes_dir = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.ssl = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.ssl_version = {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_notifications.driver = [] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_notifications.retry = -1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] oslo_messaging_notifications.transport_url = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] key_manager.fixed_key = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.barbican_api_version = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.barbican_endpoint = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.barbican_endpoint_type = public {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.barbican_region_name = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.cafile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.collect_timing = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.insecure = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.number_of_retries = 60 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.retry_delay = 1 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.send_service_user_token = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.split_loggers = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.timeout = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.verify_ssl = True {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican.verify_ssl_path = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.auth_section = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.auth_type = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.cafile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.certfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.collect_timing = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.insecure = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.keyfile = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.split_loggers = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] barbican_service_user.timeout = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.approle_role_id = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.approle_secret_id = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.kv_mountpoint = secret {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.kv_path = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.kv_version = 2 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.namespace = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.root_token_id = **** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.ssl_ca_crt_file = None {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.timeout = 60.0 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.use_ssl = False {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:58:50 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] ******************************************************************************** {{(pid=92797) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 26 21:58:50 devstack quobyte-client[93013]: Reading configuration file: /etc/quobyte/client.cfg Jun 26 21:58:50 devstack quobyte-client[93013]: Invalid parameters found, error: missing mount point. Jun 26 21:58:50 devstack quobyte-client[93013]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 26 21:58:50 devstack quobyte-client[93013]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] CMD "mount.quobyte" returned: 1 in 0.134s {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 21:58:50 devstack cinder-volume[93012]: INFO cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 ... Jun 26 21:58:50 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda -c /etc/quobyte/client-cinder.cfg {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:50 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda -c /etc/quobyte/client-cinder.cfg Jun 26 21:58:50 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:51 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.734s {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:51 devstack cinder-volume[93012]: INFO cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 succeeded Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.744s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:51 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 21:58:51 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:51 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.599s {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:51 devstack cinder-volume[93012]: INFO cinder.volume.driver [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Driver hasn't implemented _init_vendor_properties() Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG cinder.volume.driver [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6613426208496, 'free_capacity_gb': 1775.6613426208496, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93012) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG oslo_db.sqlalchemy.engines [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93012) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG dbcounter [-] [93012] Writer thread running {{(pid=93012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG cinder.db.api [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Building query based on filter {{(pid=93012) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 26 21:58:51 devstack cinder-volume[93012]: DEBUG cinder.image.image_utils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93012) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 26 21:58:52 devstack cinder-volume[93012]: INFO cinder.keymgr.migration [None req-ff31d293-285a-4e33-8679-67380739d31d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:52 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 21:58:52 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:52 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.592s {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG cinder.manager [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Notifying Schedulers of capabilities ... {{(pid=93012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:58:52 devstack cinder-volume[93012]: INFO cinder.volume.manager [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Driver initialization completed successfully. Jun 26 21:58:52 devstack cinder-volume[93012]: INFO cinder.manager [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Initiating service 3 cleanup Jun 26 21:58:52 devstack cinder-volume[93012]: INFO cinder.manager [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Service 3 cleanup completed. Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG cinder.service [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Creating RPC server for service cinder-volume {{(pid=93012) start /opt/stack/cinder/cinder/service.py:231}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG cinder.service [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93012) start /opt/stack/cinder/cinder/service.py:237}} Jun 26 21:58:52 devstack cinder-volume[93012]: INFO cinder.volume.manager [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 21:58:52 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:52 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 21:58:52 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:53 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:53 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.895s {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:53 devstack cinder-volume[93012]: INFO cinder.volume.manager [None req-7f947acf-467b-4c2f-b596-c3978988b290 None None] Driver post RPC initialization completed successfully. Jun 26 21:58:57 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 21:58:57 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 21:58:57 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93012) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 21:58:57 devstack cinder-volume[93012]: DEBUG cinder.volume.drivers.quobyte [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93012) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 21:58:57 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93012) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 21:58:57 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:58:57 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 21:58:57 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:58:58 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Jun 26 21:58:58 devstack cinder-volume[93012]: DEBUG oslo_concurrency.processutils [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.580s {{(pid=93012) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:58:58 devstack cinder-volume[93012]: DEBUG cinder.manager [None req-6882f27a-eae4-4279-ae33-827dac9ef2bc None None] Notifying Schedulers of capabilities ... {{(pid=93012) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:58:59 devstack cinder-volume[92797]: INFO oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Caught SIGTERM, stopping children Jun 26 21:58:59 devstack cinder-volume[92797]: DEBUG oslo_concurrency.lockutils [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Acquiring lock "singleton_lock" {{(pid=92797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 21:58:59 devstack cinder-volume[92797]: DEBUG oslo_concurrency.lockutils [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Acquired lock "singleton_lock" {{(pid=92797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 21:58:59 devstack cinder-volume[92797]: DEBUG oslo_concurrency.lockutils [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Releasing lock "singleton_lock" {{(pid=92797) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 21:58:59 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Stop services. {{(pid=92797) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 26 21:58:59 devstack cinder-volume[92797]: DEBUG oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Killing children. {{(pid=92797) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 26 21:58:59 devstack cinder-volume[92797]: INFO oslo_service.backend._eventlet.service [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Waiting on 1 children to exit Jun 26 21:59:02 devstack cinder-volume[93012]: DEBUG dbcounter [-] [93012] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:59:03 devstack cinder-volume[93012]: DEBUG dbcounter [-] [93012] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=93012) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:59:04 devstack cinder-volume[93012]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 26 21:59:05 devstack cinder-volume[93342]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 26 21:59:05 devstack cinder-volume[93342]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 21:59:05 devstack cinder-volume[93342]: we strongly recommend against using it for new projects. Jun 26 21:59:05 devstack cinder-volume[93342]: If you are already using Eventlet, we recommend migrating to a different Jun 26 21:59:05 devstack cinder-volume[93342]: framework. For more detail see Jun 26 21:59:05 devstack cinder-volume[93342]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 21:59:05 devstack cinder-volume[93342]: import eventlet # noqa Jun 26 21:59:06 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Acquiring lock "singleton_lock" {{(pid=93012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 21:59:06 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Acquired lock "singleton_lock" {{(pid=93012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 21:59:06 devstack cinder-volume[93012]: DEBUG oslo_concurrency.lockutils [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Releasing lock "singleton_lock" {{(pid=93012) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 21:59:06 devstack cinder-volume[93012]: WARNING amqp [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 26 21:59:06 devstack cinder-volume[93012]: WARNING amqp [None req-8864d468-49a6-4b7e-a8d3-ec85f9451d85 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 26 21:59:07 devstack cinder-volume[93342]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 21:59:07 devstack cinder-volume[93342]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 21:59:07 devstack cinder-volume[93342]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93342) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 21:59:08 devstack cinder-volume[93342]: INFO dbcounter [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Registered counter for database cinder Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_db.sqlalchemy.engines [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG dbcounter [-] [93342] Writer thread running {{(pid=93342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 26 21:59:08 devstack cinder-volume[93342]: INFO cinder.rpc [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 26 21:59:08 devstack cinder-volume[93342]: INFO cinder.rpc [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_db.sqlalchemy.engines [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:59:08 devstack cinder-volume[93342]: INFO cinder.volume.manager [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Determined volume DB was empty at startup. Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG cinder.volume.manager [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93342) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 26 21:59:08 devstack cinder-volume[93342]: WARNING stevedore.named [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 26 21:59:08 devstack cinder-volume[93342]: WARNING castellan.key_manager [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 26 21:59:08 devstack cinder-volume[93342]: WARNING cinder.keymgr.conf_key_mgr [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 26 21:59:08 devstack cinder-volume[93342]: INFO cinder.volume.manager [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_db.sqlalchemy.engines [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93342) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:59:08 devstack cinder-volume[93342]: INFO oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Starting 1 workers Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Started child 93616 {{(pid=93342) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Full set of CONF: {{(pid=93342) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] ******************************************************************************** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Configuration options gathered from: {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] ================================================================================ {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 26 21:59:08 devstack cinder-volume[93616]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] allow_availability_zone_fallback = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] allow_compression_on_image_upload = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] allowed_direct_url_schemes = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] api_rate_limit = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] auth_strategy = keystone {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_availability_zone = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_host = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_stats_polling_interval = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backup_api_class = cinder.backup.api.API {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backup_name_template = backup-%s {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backup_use_same_host = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backup_use_temp_snapshot = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] chap_password = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] chap_username = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_internal_tenant_project_id = 64bd6284f7e044218b6a360fc48cfb8d {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_internal_tenant_user_id = d6edbf63b5364e4db09ab97bf1ee5d70 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cluster = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] compression_format = gzip {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] compute_api_class = cinder.compute.nova.API {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] config_dir = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] config_source = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] control_exchange = openstack {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] debug = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] default_availability_zone = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] default_group_type = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] default_volume_type = QuobyteHD {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] disk_geometry = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] driver_client_cert = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] driver_client_cert_key = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] driver_data_namespace = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] driver_ssl_cert_path = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] driver_ssl_cert_verify = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] driver_use_ssl = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] enable_new_services = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] enable_unsupported_driver = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] enabled_backends = ['QuobyteHD'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] enforce_multipath_for_image_xfer = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] filter_function = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_api_insecure = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_api_servers = ['http://192.168.122.249/image'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_api_ssl_compression = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_ca_certificates_file = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_catalog_info = image:glance:publicURL {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_num_retries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance_request_timeout = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] goodness_function = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] graceful_shutdown_timeout = 5 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] group_api_class = cinder.group.api.API {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] host = devstack {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_compress_on_upload = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_conversion_address_space_limit = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_conversion_cpu_limit = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_conversion_disable = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_upload_use_cinder_backend = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_upload_use_internal_tenant = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_volume_cache_enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_volume_cache_max_count = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] image_volume_cache_max_size_gb = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] init_host_max_objects_retrieval = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] instance_format = [instance: %(uuid)s] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] iscsi_target_flags = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] iscsi_write_cache = on {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] iser_helper = tgtadm {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] iser_ip_address = 192.168.122.249 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] iser_port = 3260 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Starting volume driver QuobyteDriver (1.1.14) Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_color = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_config_append = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_dir = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93616) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_file = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_options = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_rotate_interval = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_rotate_interval_type = days {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] log_rotation_type = none {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] max_age = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] max_logfile_count = 30 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] max_logfile_size_mb = 200 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] max_over_subscription_ratio = 20.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] message_reap_interval = 86400 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] message_ttl = 2592000 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] migration_create_volume_timeout_secs = 300 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] monkey_patch = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] monkey_patch_modules = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] my_ip = 192.168.122.249 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] no_snapshot_gb_quota = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] num_iser_scan_tries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] num_shell_tries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] num_volume_device_scan_tries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] nvmeof_conn_info_version = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] nvmet_ns_id = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] nvmet_port_id = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] osapi_max_limit = 1000 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] osapi_volume_ext_list = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] osapi_volume_listen_port = 8776 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] osapi_volume_use_ssl = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] osapi_volume_workers = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] per_volume_size_limit = -1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] periodic_fuzzy_delay = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] periodic_interval = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] public_endpoint = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] publish_errors = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] quota_backup_gigabytes = 1000 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] quota_backups = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] quota_gigabytes = 1000 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] quota_groups = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] quota_snapshots = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] quota_volumes = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] rate_limit_burst = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] rate_limit_except_level = CRITICAL {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] rate_limit_interval = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] reinit_driver_count = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] replication_device = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] report_discard_supported = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] report_interval = 120 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] reservation_clean_interval = 86400 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] reservation_expire = 86400 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] reserved_image_namespaces = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] reserved_percentage = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] rpc_response_timeout = 120 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] run_external_periodic_tasks = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] scst_target_driver = iscsi {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] scst_target_iqn_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_down_time = 720 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] shell_completion = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] snapshot_name_template = snapshot-%s {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] split_loggers = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] state_path = /opt/stack/data/cinder {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] storage_availability_zone = nova {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] storage_protocol = iSCSI {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] syslog_log_facility = LOG_USER {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] target_helper = lioadm {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] target_ip_address = 192.168.122.249 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] target_port = 3260 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] target_protocol = iscsi {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] target_secondary_ip_addresses = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] trace_flags = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] transport_url = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] until_refresh = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] use_chap_auth = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] use_default_quota_class = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] use_journal = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] use_json = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] use_multipath_for_image_xfer = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] use_stderr = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] use_syslog = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] verify_glance_signatures = enabled {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_api_class = cinder.volume.api.API {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_backend_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_clear = zero {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_clear_ionice = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_clear_size = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_copy_bps_limit = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_dd_blocksize = 1M {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_name_template = volume-%s {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_service_inithost_offload = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volume_usage_audit_period = month {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] zoning_mode = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_concurrency.disable_process_locking = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.auth_section = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.auth_type = password {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.auth_version = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.cache = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.include_service_catalog = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.insecure = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.interface = public {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_password = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcache_username = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.region_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.service_type = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.249/identity {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.backend = dogpile.cache.null {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.backend_argument = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.backend_expiration_time = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.config_prefix = cache.oslo {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.debug_cache_backend = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.enable_retry_client = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.enable_socket_keepalive = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.expiration_time = 600 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.hashclient_retry_attempts = 2 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93616) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 26 21:59:08 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 26 21:59:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Running cmd (subprocess): mount.quobyte {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.memcache_dead_retry = 300 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.memcache_pool_maxsize = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.memcache_sasl_enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.password = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.proxies = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.redis_db = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.redis_server = localhost:6379 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.retry_attempts = 2 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.retry_delay = 0.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.socket_keepalive_count = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.socket_keepalive_idle = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.socket_keepalive_interval = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.socket_timeout = 1.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.tls_allowed_ciphers = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.tls_cafile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.tls_certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.tls_enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.tls_keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cache.username = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] coordination.backend_url = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.asyncio_connection = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.asyncio_slave_connection = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.backend = sqlalchemy {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.connection = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.connection_debug = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.connection_parameters = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.connection_recycle_time = 3600 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.connection_trace = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.db_inc_retry_interval = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.db_max_retries = 20 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.db_max_retry_interval = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.db_retry_interval = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.max_overflow = 50 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.max_pool_size = 5 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.max_retries = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.mysql_wsrep_sync_wait = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.pool_timeout = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.retry_interval = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.slave_connection = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.sqlite_synchronous = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.synchronous_reader = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] database.use_db_reconnect = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.connection_string = messaging:// {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.es_doc_type = notification {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.es_scroll_size = 10000 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.es_scroll_time = 2m {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.filter_error_trace = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.hmac_keys = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.sentinel_service_name = mymaster {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.socket_timeout = 0.1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.trace_requests = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler.trace_sqlalchemy = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler_jaeger.process_tags = {} {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler_jaeger.service_name_prefix = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] profiler_otlp.service_name_prefix = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.enforce_new_defaults = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: WARNING oslo_config.cfg [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.enforce_scope = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.policy_default_rule = default {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.policy_file = policy.yaml {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] privsep_osbrick.group = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] privsep_osbrick.helper_command = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] privsep_osbrick.user = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_sys_admin.group = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_sys_admin.helper_command = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] cinder_sys_admin.user = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.auth_section = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.auth_type = password {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.cafile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.collect_timing = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.insecure = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.send_service_user_token = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.split_loggers = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] service_user.timeout = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.auth_section = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.auth_type = password {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.collect_timing = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.insecure = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.region_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.split_loggers = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] glance.timeout = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.backend_availability_zone = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.chap_password = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.chap_username = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.disk_geometry = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.driver_client_cert = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.driver_client_cert_key = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.driver_data_namespace = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.driver_use_ssl = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.extra_capabilities = {} {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.filter_function = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.goodness_function = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.iscsi_target_flags = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.iscsi_write_cache = on {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.iser_helper = tgtadm {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.iser_ip_address = 192.168.122.249 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.iser_port = 3260 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_host = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_login = admin {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_mount_options = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_password = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_private_key = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_share_path = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.num_shell_tries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.quobyte_volume_url = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.replication_device = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.report_discard_supported = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.reserved_percentage = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.target_helper = tgtadm {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.target_ip_address = 192.168.122.249 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.target_port = 3260 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.target_protocol = iscsi {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.trace_flags = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.unique_fqdn_network = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.use_chap_auth = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_backend_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:08 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_clear = zero {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_clear_ionice = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_clear_size = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack quobyte-client[93619]: Reading configuration file: /etc/quobyte/client.cfg Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_reports.file_event_handler = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_reports.log_dir = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.backend_availability_zone = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.backend_host = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack quobyte-client[93619]: Invalid parameters found, error: missing mount point. Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.chap_password = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.chap_username = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.chiscsi_conf = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.disk_geometry = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.driver_client_cert = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack quobyte-client[93619]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.driver_data_namespace = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack quobyte-client[93619]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.driver_use_ssl = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.extra_capabilities = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.filter_function = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.goodness_function = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.iser_helper = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.iser_ip_address = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.iser_port = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.iser_target_prefix = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_host = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_login = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_mount_options = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_password = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_private_key = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_share_path = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_ssh_port = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.num_shell_tries = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.nvmet_port_id = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.replication_device = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.report_discard_supported = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.reserved_percentage = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.scst_target_driver = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.storage_protocol = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.target_helper = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.target_ip_address = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.target_port = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.target_prefix = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.target_protocol = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.trace_flags = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.use_chap_auth = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_clear = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_clear_size = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] QuobyteHD.volumes_dir = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.ssl = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_notifications.driver = [] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_notifications.retry = -1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] key_manager.fixed_key = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.barbican_api_version = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.barbican_endpoint = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.barbican_endpoint_type = public {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.barbican_region_name = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.cafile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.collect_timing = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 21:59:09 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.insecure = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.number_of_retries = 60 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.retry_delay = 1 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.send_service_user_token = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.split_loggers = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.timeout = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.verify_ssl = True {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican.verify_ssl_path = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.auth_section = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.auth_type = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.cafile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.certfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.collect_timing = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.insecure = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.keyfile = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.split_loggers = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] barbican_service_user.timeout = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.approle_role_id = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.approle_secret_id = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.kv_mountpoint = secret {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.kv_path = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.kv_version = 2 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.namespace = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.root_token_id = **** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.ssl_ca_crt_file = None {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.timeout = 60.0 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.use_ssl = False {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 26 21:59:09 devstack cinder-volume[93342]: DEBUG oslo_service.backend._eventlet.service [None req-403efb19-5d4d-408f-b89a-deb4f6b74d93 None None] ******************************************************************************** {{(pid=93342) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 26 21:59:09 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.676s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:59:09 devstack cinder-volume[93616]: INFO cinder.volume.driver [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Driver hasn't implemented _init_vendor_properties() Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG cinder.volume.driver [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6863327026367, 'free_capacity_gb': 1775.6863327026367, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93616) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_db.sqlalchemy.engines [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writer thread running {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG cinder.db.api [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Building query based on filter {{(pid=93616) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93616) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 21:59:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:59:09 devstack cinder-volume[93616]: INFO cinder.keymgr.migration [None req-e146c692-bce4-45d8-8c47-9021f1412a9a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 26 21:59:09 devstack sudo[93666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 21:59:09 devstack sudo[93666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:59:10 devstack sudo[93666]: pam_unix(sudo:session): session closed for user root Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.680s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 21:59:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Driver initialization completed successfully. Jun 26 21:59:10 devstack cinder-volume[93616]: INFO cinder.manager [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Initiating service 3 cleanup Jun 26 21:59:10 devstack cinder-volume[93616]: INFO cinder.manager [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Service 3 cleanup completed. Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG cinder.service [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Creating RPC server for service cinder-volume {{(pid=93616) start /opt/stack/cinder/cinder/service.py:231}} Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG cinder.service [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93616) start /opt/stack/cinder/cinder/service.py:237}} Jun 26 21:59:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 21:59:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 21:59:10 devstack sudo[93685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 21:59:10 devstack sudo[93685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 21:59:11 devstack sudo[93685]: pam_unix(sudo:session): session closed for user root Jun 26 21:59:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.623s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 21:59:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4d18e15d-eafe-4849-90ec-5b98e17854bd None None] Driver post RPC initialization completed successfully. Jun 26 21:59:18 devstack cinder-volume[93342]: DEBUG dbcounter [-] [93342] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93342) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:59:20 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=3 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:59:21 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 21:59:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 21:59:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 6 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 21:59:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Flow 'volume_create_manager' (e7b2ffea-bd74-45b1-8ff7-1adefcbd5ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d8f5b9-04e0-4fbc-8b1f-5e41c11b50da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d8f5b9-04e0-4fbc-8b1f-5e41c11b50da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-217583835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a4c9e2-6fe8-4c52-9411-d952ed01579b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a806c9bf7e474c9c6baa1e678d7b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:00:06Z,use_quota=True,user_id='b0be742df06f444a85b3b3518eb76ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0da5106-09bf-437a-8862-d6b31ebf0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0da5106-09bf-437a-8862-d6b31ebf0126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7185f84a-2f3d-46d9-9df5-5c6c40d656b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7185f84a-2f3d-46d9-9df5-5c6c40d656b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a4c9e2-6fe8-4c52-9411-d952ed01579b', 'volume_name': 'volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c024459-e199-4e17-a8fd-ffab79d4df34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c024459-e199-4e17-a8fd-ffab79d4df34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9fc8ee-a344-44ee-8f92-c70844c1c71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:06 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Volume 72a4c9e2-6fe8-4c52-9411-d952ed01579b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b', 'volume_size': 1} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:00:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-217583835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72a4c9e2-6fe8-4c52-9411-d952ed01579b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63a806c9bf7e474c9c6baa1e678d7b98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:00:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:00:06Z,use_quota=True,user_id='b0be742df06f444a85b3b3518eb76ed6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Creating volume 72a4c9e2-6fe8-4c52-9411-d952ed01579b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:00:06 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:00:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:06 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b 1073741824 Jun 26 22:00:06 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:07 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b 1073741824" returned: 0 in 1.117s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:07 devstack sudo[94308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b Jun 26 22:00:07 devstack sudo[94308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:08 devstack sudo[94308]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b" returned: 0 in 0.992s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] <== create_volume: return (2175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:00:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9fc8ee-a344-44ee-8f92-c70844c1c71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b12c66-f733-45df-984c-fb49c4a34064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:08 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Volume volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b (72a4c9e2-6fe8-4c52-9411-d952ed01579b): created successfully Jun 26 22:00:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b12c66-f733-45df-984c-fb49c4a34064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Flow 'volume_create_manager' (e7b2ffea-bd74-45b1-8ff7-1adefcbd5ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:00:08 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0dba68d3-b47e-43ac-9284-fbc7c6f3c00f tempest-TaggedAttachmentsTest-214769842 None] Created volume successfully. Jun 26 22:00:18 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=4,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:00:18 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Flow 'volume_create_manager' (3e412af2-2441-4dc1-8eed-4a854feecbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd78b9f5-e9d1-402c-bc48-c73670960a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd78b9f5-e9d1-402c-bc48-c73670960a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-327167938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b976ce49-0092-4b22-a222-7e8d9e8aeb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be758f40ddca437086cd8f7ee4d40bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:00:38Z,use_quota=True,user_id='a00c4de901f14cd7871a5424fe70de17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16f1268-e6b4-41ae-a44d-f38ce5bdfaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f16f1268-e6b4-41ae-a44d-f38ce5bdfaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68595e3a-6c2c-42d2-91b0-82d989067481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68595e3a-6c2c-42d2-91b0-82d989067481) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b976ce49-0092-4b22-a222-7e8d9e8aeb84', 'volume_name': 'volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cb3cfe-bc82-4247-8d1f-fdb20838cd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9cb3cfe-bc82-4247-8d1f-fdb20838cd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2b10ad-8db5-47da-93a0-6637913675b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Volume b976ce49-0092-4b22-a222-7e8d9e8aeb84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84', 'volume_size': 1} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:00:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-327167938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b976ce49-0092-4b22-a222-7e8d9e8aeb84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be758f40ddca437086cd8f7ee4d40bf0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:00:38Z,use_quota=True,user_id='a00c4de901f14cd7871a5424fe70de17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Creating volume b976ce49-0092-4b22-a222-7e8d9e8aeb84 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:00:38 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:00:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:38 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 1073741824 Jun 26 22:00:38 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:39 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 1073741824" returned: 0 in 1.343s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:39 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 Jun 26 22:00:39 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:40 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84" returned: 0 in 1.060s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] <== create_volume: return (2479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:00:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.482s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb2b10ad-8db5-47da-93a0-6637913675b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e4a83-4f62-4bd9-9df4-0faa98c28e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:40 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Volume volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 (b976ce49-0092-4b22-a222-7e8d9e8aeb84): created successfully Jun 26 22:00:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a17e4a83-4f62-4bd9-9df4-0faa98c28e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Flow 'volume_create_manager' (3e412af2-2441-4dc1-8eed-4a854feecbf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:00:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6c682bed-1c6c-45a0-bfd6-227ada2991e9 tempest-DeleteServersTestJSON-2141140660 None] Created volume successfully. Jun 26 22:00:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:00:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:00:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:00:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:46 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:00:46 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:48 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 2.317s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:48 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:00:48 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:00:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 6 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:00:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Flow 'volume_create_manager' (ef92ace8-e746-4c14-96d2-8b58d52921ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ad9959-a5e7-4337-b9ca-c2f4b071bc3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72ad9959-a5e7-4337-b9ca-c2f4b071bc3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1168591584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d91c44-787a-4e37-8af9-dd1a02f217f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa580ac80c3047258d7acd1fa793e299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:00:50Z,use_quota=True,user_id='6f59058fd1c34c5dbef3f27be06d1950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384d0280-457d-47ed-94e9-860a182e0570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (384d0280-457d-47ed-94e9-860a182e0570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a503c3-4cb0-4e59-90cf-45b862ff8be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6a503c3-4cb0-4e59-90cf-45b862ff8be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2d91c44-787a-4e37-8af9-dd1a02f217f2', 'volume_name': 'volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f85154-0f11-4399-a2d6-716e7f70b39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4f85154-0f11-4399-a2d6-716e7f70b39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c94b047-ed12-4062-8e85-431aa258a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:50 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Volume e2d91c44-787a-4e37-8af9-dd1a02f217f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2', 'volume_size': 1} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1168591584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2d91c44-787a-4e37-8af9-dd1a02f217f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa580ac80c3047258d7acd1fa793e299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:00:50Z,use_quota=True,user_id='6f59058fd1c34c5dbef3f27be06d1950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Creating volume e2d91c44-787a-4e37-8af9-dd1a02f217f2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:00:50 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:00:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:50 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 1073741824 Jun 26 22:00:50 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:51 devstack cinder-volume[93616]: WARNING py.warnings [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jun 26 22:00:51 devstack cinder-volume[93616]: .first() Jun 26 22:00:51 devstack cinder-volume[93616]: Jun 26 22:00:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:00:52 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 1073741824" returned: 0 in 2.320s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:52 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 Jun 26 22:00:52 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:54 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2" returned: 0 in 1.327s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] <== create_volume: return (3706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.710s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.821s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:00:54 devstack cinder-volume[93616]: INFO oslo.privsep.daemon [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn7sqe_t8/privsep.sock'] Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c94b047-ed12-4062-8e85-431aa258a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7834d43e-bf55-492a-8a43-bfdb37f4a2f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:00:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Volume volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 (e2d91c44-787a-4e37-8af9-dd1a02f217f2): created successfully Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7834d43e-bf55-492a-8a43-bfdb37f4a2f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:00:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Flow 'volume_create_manager' (ef92ace8-e746-4c14-96d2-8b58d52921ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:00:54 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn7sqe_t8/privsep.sock Jun 26 22:00:54 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d57875be-19a0-4804-ade1-f2da340c54aa tempest-VolumesAdminNegativeTest-435693676 None] Created volume successfully. Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 22:00:55 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 26 22:00:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Acquiring lock "cinder-e2d91c44-787a-4e37-8af9-dd1a02f217f2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:00:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Lock "cinder-e2d91c44-787a-4e37-8af9-dd1a02f217f2-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:00:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Acquiring lock "cinder-quobyte-e2d91c44-787a-4e37-8af9-dd1a02f217f2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:00:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Lock "cinder-quobyte-e2d91c44-787a-4e37-8af9-dd1a02f217f2" acquired by "delete_volume" :: waited 0.064s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 26 22:00:56 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:56 devstack cinder-volume[93616]: INFO oslo.privsep.daemon [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Spawned new privsep daemon via rootwrap Jun 26 22:00:56 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Accepted privsep connection to /tmp/tmpn7sqe_t8/privsep.sock {{(pid=93616) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 26 22:00:56 devstack cinder-volume[93616]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 26 22:00:56 devstack cinder-volume[93616]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 26 22:00:56 devstack cinder-volume[93616]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 26 22:00:56 devstack cinder-volume[93616]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94904 Jun 26 22:00:56 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d129ea-14ac-41c0-ac2e-5af25c99d4ed]: (2,) {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:00:56 devstack cinder-volume[93616]: WARNING oslo_privsep.priv_context [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] privsep daemon already running Jun 26 22:00:57 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b957cfa4-71ac-4103-9802-81a1ee18a17c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:00:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:57 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6594ff99-ebe8-402c-81ef-ef07ced97bae]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:00:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:57 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 Jun 26 22:00:57 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:57 devstack sudo[94909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 Jun 26 22:00:57 devstack sudo[94909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:58 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84" returned: 0 in 1.975s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.758s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:00:59 devstack sudo[94909]: pam_unix(sudo:session): session closed for user root Jun 26 22:00:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2" returned: 0 in 1.990s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:00:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:00:59 devstack sudo[94919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2 Jun 26 22:00:59 devstack sudo[94919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:00:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fa7b05f-815e-460f-94eb-84e619e00b4d', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:00:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-ae7bd476-0eb8-48fa-9aee-0940d2e20983 req-10f1cb2b-3c03-41a0-afdd-cf5c959233cc tempest-DeleteServersTestJSON-2141140660 None] attachment_update completed successfully. Jun 26 22:01:00 devstack sudo[94919]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e2d91c44-787a-4e37-8af9-dd1a02f217f2" returned: 0 in 1.563s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Lock "cinder-quobyte-e2d91c44-787a-4e37-8af9-dd1a02f217f2" released by "delete_volume" :: held 4.802s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:01:00 devstack cinder-volume[93616]: WARNING cinder.quota [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:01:00 devstack cinder-volume[93616]: WARNING cinder.quota [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:01:00 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Created reservations ['38f8c626-744a-4906-9405-73b2d8fcf46c', '49485e09-9966-43c9-bc21-45b018c2397a', '22db1c01-f1ff-4866-bdbc-256dd75d4115', 'a5947c21-ca34-4292-b0d2-f1dcdd569268'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:01:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:01:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:01:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:01:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:01:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:01:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:01 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:01:01 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:02 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:02 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:01:02 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Deleted volume successfully. Jun 26 22:01:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-624ec927-add2-483f-ae1e-13c8efa5392d tempest-VolumesAdminNegativeTest-435693676 None] Lock "cinder-e2d91c44-787a-4e37-8af9-dd1a02f217f2-delete_volume" released by "delete_volume" :: held 7.420s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:01:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-bd223b8b-d51d-4507-a07e-3e9002238641 req-e45149b2-59d1-4591-bf84-2c2c3084cf9d tempest-DeleteServersTestJSON-2141140660 None] Terminate volume connection completed successfully. Jun 26 22:01:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-bd223b8b-d51d-4507-a07e-3e9002238641 req-e45149b2-59d1-4591-bf84-2c2c3084cf9d tempest-DeleteServersTestJSON-2141140660 None] Deleting attachment 9fa7b05f-815e-460f-94eb-84e619e00b4d. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:01:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Acquiring lock "cinder-b976ce49-0092-4b22-a222-7e8d9e8aeb84-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:01:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Lock "cinder-b976ce49-0092-4b22-a222-7e8d9e8aeb84-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:01:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Acquiring lock "cinder-quobyte-b976ce49-0092-4b22-a222-7e8d9e8aeb84" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:01:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Lock "cinder-quobyte-b976ce49-0092-4b22-a222-7e8d9e8aeb84" acquired by "delete_volume" :: waited 0.032s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:01:20 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6717cc5-12c6-4c5a-b287-e380ad2173dc]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:01:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:20 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 Jun 26 22:01:20 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:20 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84" returned: 0 in 0.828s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:20 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84 Jun 26 22:01:20 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:21 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b976ce49-0092-4b22-a222-7e8d9e8aeb84" returned: 0 in 0.695s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Lock "cinder-quobyte-b976ce49-0092-4b22-a222-7e8d9e8aeb84" released by "delete_volume" :: held 1.605s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Created reservations ['218479cb-07e8-4b53-a7b1-2f03062bb113', 'a3f84c69-391a-41aa-8248-b8382bf5bdf4', 'f3f8800c-fd27-4fd9-8b6c-42eabe1eeedd', '378e1660-dde6-4608-85ad-bbd7c6c89b4a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:01:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:21 devstack sudo[95590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:01:21 devstack sudo[95590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:22 devstack sudo[95590]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.707s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:22 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:01:22 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Deleted volume successfully. Jun 26 22:01:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-da6e5708-0a15-4aa6-916c-89a4925bd397 tempest-DeleteServersTestJSON-2141140660 None] Lock "cinder-b976ce49-0092-4b22-a222-7e8d9e8aeb84-delete_volume" released by "delete_volume" :: held 2.569s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:01:31 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=27,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=4 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:01:32 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=20,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=2 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:01:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:01:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:01:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:01:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:01:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:01:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:01:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:46 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:01:46 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:47 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.303s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Flow 'volume_create_manager' (793ae5db-92b1-41aa-8fbf-68da5e0deb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf5c73f-0982-4cf1-bece-39bcd2a2c392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bf5c73f-0982-4cf1-bece-39bcd2a2c392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-801828814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b05925d-62ed-431a-9f3d-641ecb252bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac57c6f6d6e4135bc9cf1f99a5abf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:01:50Z,use_quota=True,user_id='e97e0598728347f993f90f95b0fb65e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfc81d3-1644-40e3-981a-9251b4a93a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cfc81d3-1644-40e3-981a-9251b4a93a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0801c371-ec27-4a7c-b8a7-90d989721554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0801c371-ec27-4a7c-b8a7-90d989721554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b05925d-62ed-431a-9f3d-641ecb252bc8', 'volume_name': 'volume-0b05925d-62ed-431a-9f3d-641ecb252bc8', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d9a119-8464-4b9d-bbb4-c0c1b111136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0d9a119-8464-4b9d-bbb4-c0c1b111136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d505daee-3df0-4d4e-80e4-c392eb7869e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:01:50 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Volume 0b05925d-62ed-431a-9f3d-641ecb252bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b05925d-62ed-431a-9f3d-641ecb252bc8', 'volume_size': 1} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:01:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-801828814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b05925d-62ed-431a-9f3d-641ecb252bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bac57c6f6d6e4135bc9cf1f99a5abf7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:01:50Z,use_quota=True,user_id='e97e0598728347f993f90f95b0fb65e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Creating volume 0b05925d-62ed-431a-9f3d-641ecb252bc8 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:01:50 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:01:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:50 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 1073741824 Jun 26 22:01:50 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:52 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 1073741824" returned: 0 in 1.435s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:52 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 Jun 26 22:01:52 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:52 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8" returned: 0 in 0.839s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:01:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:01:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d505daee-3df0-4d4e-80e4-c392eb7869e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b05925d-62ed-431a-9f3d-641ecb252bc8', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:01:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc95483b-ff43-4d36-89bb-791258783165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:01:53 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Volume volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 (0b05925d-62ed-431a-9f3d-641ecb252bc8): created successfully Jun 26 22:01:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc95483b-ff43-4d36-89bb-791258783165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:01:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Flow 'volume_create_manager' (793ae5db-92b1-41aa-8fbf-68da5e0deb9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:01:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5059dfb2-f6ee-495e-82a9-b0a95af0a49c tempest-ServerRescueNegativeTestJSON-1532547773 None] Created volume successfully. Jun 26 22:01:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-4f239243-a661-4f6f-9e73-c3bfcfc21b71 req-12ba8b76-5ab5-46c9-aa53-8f49200e480c tempest-TaggedAttachmentsTest-214769842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:01:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-4f239243-a661-4f6f-9e73-c3bfcfc21b71 req-12ba8b76-5ab5-46c9-aa53-8f49200e480c tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:01:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd16ef-52fd-4920-8b02-5b50832a1a1d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:01:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-4f239243-a661-4f6f-9e73-c3bfcfc21b71 req-12ba8b76-5ab5-46c9-aa53-8f49200e480c tempest-TaggedAttachmentsTest-214769842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:01:54 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b Jun 26 22:01:54 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:01:56 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Jun 26 22:01:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-4f239243-a661-4f6f-9e73-c3bfcfc21b71 req-12ba8b76-5ab5-46c9-aa53-8f49200e480c tempest-TaggedAttachmentsTest-214769842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b" returned: 0 in 1.355s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:01:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-4f239243-a661-4f6f-9e73-c3bfcfc21b71 req-12ba8b76-5ab5-46c9-aa53-8f49200e480c tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.385s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:01:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-4f239243-a661-4f6f-9e73-c3bfcfc21b71 req-12ba8b76-5ab5-46c9-aa53-8f49200e480c tempest-TaggedAttachmentsTest-214769842 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd59cfd01-357f-4788-a668-0d8ee0ca5117', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:01:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-4f239243-a661-4f6f-9e73-c3bfcfc21b71 req-12ba8b76-5ab5-46c9-aa53-8f49200e480c tempest-TaggedAttachmentsTest-214769842 None] attachment_update completed successfully. Jun 26 22:02:05 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-5bbfa5a4-5f46-4abe-8aa8-188768146631 req-6c50c1bf-acbf-412a-ba55-912cdbb9fb17 tempest-TaggedAttachmentsTest-214769842 None] Terminate volume connection completed successfully. Jun 26 22:02:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-5bbfa5a4-5f46-4abe-8aa8-188768146631 req-6c50c1bf-acbf-412a-ba55-912cdbb9fb17 tempest-TaggedAttachmentsTest-214769842 None] Deleting attachment d59cfd01-357f-4788-a668-0d8ee0ca5117. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:02:06 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:02:15 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=7,cinder:SELECT=8,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:02:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Acquiring lock "cinder-0b05925d-62ed-431a-9f3d-641ecb252bc8-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:02:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "cinder-0b05925d-62ed-431a-9f3d-641ecb252bc8-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:02:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Acquiring lock "cinder-quobyte-0b05925d-62ed-431a-9f3d-641ecb252bc8" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:02:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "cinder-quobyte-0b05925d-62ed-431a-9f3d-641ecb252bc8" acquired by "delete_volume" :: waited 0.054s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:02:22 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[834ff06e-6d74-4c41-a7da-14077069b8b5]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:02:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:22 devstack sudo[97023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 Jun 26 22:02:22 devstack sudo[97023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:24 devstack sudo[97023]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8" returned: 0 in 2.566s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:24 devstack sudo[97098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8 Jun 26 22:02:24 devstack sudo[97098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:27 devstack sudo[97098]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0b05925d-62ed-431a-9f3d-641ecb252bc8" returned: 0 in 2.615s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "cinder-quobyte-0b05925d-62ed-431a-9f3d-641ecb252bc8" released by "delete_volume" :: held 5.322s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Created reservations ['7d25a32d-57f8-4e31-bc94-73a8edb1e74d', 'ec5ec555-9856-4ccf-9def-41b477ccadbf', '14e998f9-6101-4a54-971f-d7783bba6d47', '1c30b951-c111-45b0-a300-fc1e1ed19aaa'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:02:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:27 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:02:27 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:29 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.617s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:29 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:02:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Deleted volume successfully. Jun 26 22:02:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d1a1e86b-36dd-4cce-9116-8a8dd89a6fcc tempest-ServerRescueNegativeTestJSON-1532547773 None] Lock "cinder-0b05925d-62ed-431a-9f3d-641ecb252bc8-delete_volume" released by "delete_volume" :: held 7.397s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:02:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Acquiring lock "cinder-72a4c9e2-6fe8-4c52-9411-d952ed01579b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:02:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Lock "cinder-72a4c9e2-6fe8-4c52-9411-d952ed01579b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:02:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Acquiring lock "cinder-quobyte-72a4c9e2-6fe8-4c52-9411-d952ed01579b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:02:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Lock "cinder-quobyte-72a4c9e2-6fe8-4c52-9411-d952ed01579b" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:02:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca74f8b8-29cc-41f9-8221-b5910b738886]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:02:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:38 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b Jun 26 22:02:38 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:39 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b" returned: 0 in 1.427s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:39 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b Jun 26 22:02:39 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:40 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a4c9e2-6fe8-4c52-9411-d952ed01579b" returned: 0 in 1.382s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Lock "cinder-quobyte-72a4c9e2-6fe8-4c52-9411-d952ed01579b" released by "delete_volume" :: held 2.915s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Created reservations ['63b8ad32-bc37-44d1-959b-bcd8c9797011', 'be84d261-cab3-4e06-945b-acecd2b527c4', '85b1dbaa-8643-41be-bf43-f52d2b8aa772', '31b4f96d-d88c-4c6b-ac2a-6ca607d54c45'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:02:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:40 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:02:40 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:42 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.251s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:42 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:02:42 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Deleted volume successfully. Jun 26 22:02:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56e0bac8-ba2c-456c-823f-94a3da3b8d51 tempest-TaggedAttachmentsTest-214769842 None] Lock "cinder-72a4c9e2-6fe8-4c52-9411-d952ed01579b-delete_volume" released by "delete_volume" :: held 4.573s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:46 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:02:46 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:46 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.657s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:46 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:02:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:02:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 8 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:02:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:02:50 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=19,cinder:SELECT=8,cinder:INSERT=5,cinder:DELETE=2 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Flow 'volume_create_manager' (aaf5892a-51ce-472a-a994-b46f2d86fbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb8e0d2-a76b-499c-8ee8-76be78362c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb8e0d2-a76b-499c-8ee8-76be78362c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1680045212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c828f9-924d-4101-b60c-8edde1c4dfa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9fbce2260d4999809b6de7b5017a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:02:52Z,use_quota=True,user_id='14994b48ee92471f8657b0a08c868d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4428dd43-9fe8-4b3f-a94c-3b9527439b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4428dd43-9fe8-4b3f-a94c-3b9527439b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d229b42-6538-4ffa-9cfa-bd19171fd538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d229b42-6538-4ffa-9cfa-bd19171fd538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81c828f9-924d-4101-b60c-8edde1c4dfa1', 'volume_name': 'volume-81c828f9-924d-4101-b60c-8edde1c4dfa1', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba340b5-725d-4485-96a3-421ffec6b868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba340b5-725d-4485-96a3-421ffec6b868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e20380f-98d0-416f-a1ab-dccf7e7fced2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:52 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Volume 81c828f9-924d-4101-b60c-8edde1c4dfa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81c828f9-924d-4101-b60c-8edde1c4dfa1', 'volume_size': 1} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1680045212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81c828f9-924d-4101-b60c-8edde1c4dfa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9fbce2260d4999809b6de7b5017a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:02:52Z,use_quota=True,user_id='14994b48ee92471f8657b0a08c868d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Creating volume 81c828f9-924d-4101-b60c-8edde1c4dfa1 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:02:52 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:02:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:52 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 1073741824 Jun 26 22:02:52 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:53 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 1073741824" returned: 0 in 1.083s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:53 devstack sudo[97465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 Jun 26 22:02:53 devstack sudo[97465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Flow 'volume_create_manager' (b1a464eb-496f-4c94-a98a-1b862454ab30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1c40e6-a590-46e5-a2a8-30cfba4fc3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db1c40e6-a590-46e5-a2a8-30cfba4fc3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1120592879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ff69a7-b67b-480a-861d-2a15226b4247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe3dbad7e674b0d93b0148933c76bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:02:54Z,use_quota=True,user_id='473cc2f8281f413aad0f6042032eba1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff78e55-98f3-4e1c-a5b1-8af57a69bb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ff78e55-98f3-4e1c-a5b1-8af57a69bb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92854bd8-8417-4a45-951f-a2af6592ccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92854bd8-8417-4a45-951f-a2af6592ccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44ff69a7-b67b-480a-861d-2a15226b4247', 'volume_name': 'volume-44ff69a7-b67b-480a-861d-2a15226b4247', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627c4716-ecc5-4bb4-850c-967e0557d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627c4716-ecc5-4bb4-850c-967e0557d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c250d46-5716-4ac8-b06a-2a2a02a12b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Volume 44ff69a7-b67b-480a-861d-2a15226b4247: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44ff69a7-b67b-480a-861d-2a15226b4247', 'volume_size': 1} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:02:54 devstack sudo[97465]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1" returned: 0 in 0.902s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] <== create_volume: return (2050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.053s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:02:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1120592879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ff69a7-b67b-480a-861d-2a15226b4247,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe3dbad7e674b0d93b0148933c76bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:02:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:02:54Z,use_quota=True,user_id='473cc2f8281f413aad0f6042032eba1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Creating volume 44ff69a7-b67b-480a-861d-2a15226b4247 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:02:54 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e20380f-98d0-416f-a1ab-dccf7e7fced2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81c828f9-924d-4101-b60c-8edde1c4dfa1', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:54 devstack sudo[97469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 1073741824 Jun 26 22:02:54 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68c115f-7393-4cc5-a0a9-520144275ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Volume volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 (81c828f9-924d-4101-b60c-8edde1c4dfa1): created successfully Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c68c115f-7393-4cc5-a0a9-520144275ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Flow 'volume_create_manager' (aaf5892a-51ce-472a-a994-b46f2d86fbe9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:02:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b59c65bf-cf33-47ba-b026-c52c07d229e0 tempest-ServersNegativeTestJSON-563916048 None] Created volume successfully. Jun 26 22:02:55 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 1073741824" returned: 0 in 1.075s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:02:55 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 Jun 26 22:02:55 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:02:56 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Jun 26 22:02:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247" returned: 0 in 0.895s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:02:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:02:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.017s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:02:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c250d46-5716-4ac8-b06a-2a2a02a12b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ff69a7-b67b-480a-861d-2a15226b4247', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2c4e43-eec7-4ac7-941a-5f1ba6d8ac24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:02:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Volume volume-44ff69a7-b67b-480a-861d-2a15226b4247 (44ff69a7-b67b-480a-861d-2a15226b4247): created successfully Jun 26 22:02:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e2c4e43-eec7-4ac7-941a-5f1ba6d8ac24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:02:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Flow 'volume_create_manager' (b1a464eb-496f-4c94-a98a-1b862454ab30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:02:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-dc6b108d-71cb-4625-a133-4fab2956f287 tempest-AttachVolumeTestJSON-1084016956 None] Created volume successfully. Jun 26 22:03:00 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:03:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Flow 'volume_create_manager' (2935024c-9468-42c5-ac3a-66d816c3a3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:03:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906837b0-6cca-4ec2-9195-c6a115d5f356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (906837b0-6cca-4ec2-9195-c6a115d5f356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1072405833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da8323c-2442-47f1-ad2f-bd73e90cb3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9fbce2260d4999809b6de7b5017a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:01Z,use_quota=True,user_id='14994b48ee92471f8657b0a08c868d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8863ed-9f0f-47ee-898f-30a26a4105eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8863ed-9f0f-47ee-898f-30a26a4105eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1db540-620f-4e75-95ca-7b86e27d0b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b1db540-620f-4e75-95ca-7b86e27d0b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da8323c-2442-47f1-ad2f-bd73e90cb3ac', 'volume_name': 'volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1afd45f-da09-457e-aa69-fb3088140879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1afd45f-da09-457e-aa69-fb3088140879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2f69dd-3d80-451d-8937-ea931629fa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:01 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Volume 6da8323c-2442-47f1-ad2f-bd73e90cb3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac', 'volume_size': 1} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1072405833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da8323c-2442-47f1-ad2f-bd73e90cb3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df9fbce2260d4999809b6de7b5017a2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:01Z,use_quota=True,user_id='14994b48ee92471f8657b0a08c868d49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Creating volume 6da8323c-2442-47f1-ad2f-bd73e90cb3ac {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:03:01 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:01 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac 1073741824 Jun 26 22:03:01 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-036e7098-fe82-49d6-a231-c4032e3ae0ea req-bc73614e-ba8c-4b7a-a324-759e008f0214 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:02 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac 1073741824" returned: 0 in 1.018s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:02 devstack sudo[97535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac Jun 26 22:03:02 devstack sudo[97535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:02 devstack sudo[97535]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac" returned: 0 in 0.740s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] <== create_volume: return (1824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-036e7098-fe82-49d6-a231-c4032e3ae0ea req-bc73614e-ba8c-4b7a-a324-759e008f0214 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.596s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c2f69dd-3d80-451d-8937-ea931629fa85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f88aa7-6ca6-4cfe-9377-f4dfcd81386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7845e91-29d0-4a6e-8e35-82d6f58a75c7]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:03:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-036e7098-fe82-49d6-a231-c4032e3ae0ea req-bc73614e-ba8c-4b7a-a324-759e008f0214 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:03 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Volume volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac (6da8323c-2442-47f1-ad2f-bd73e90cb3ac): created successfully Jun 26 22:03:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f88aa7-6ca6-4cfe-9377-f4dfcd81386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Flow 'volume_create_manager' (2935024c-9468-42c5-ac3a-66d816c3a3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:03:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-60976c7d-6f81-4d37-90ef-4e0c4f406afb tempest-ServersNegativeTestJSON-563916048 None] Created volume successfully. Jun 26 22:03:03 devstack sudo[97538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 Jun 26 22:03:03 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:03 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-036e7098-fe82-49d6-a231-c4032e3ae0ea req-bc73614e-ba8c-4b7a-a324-759e008f0214 tempest-AttachVolumeTestJSON-1084016956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247" returned: 0 in 0.896s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-036e7098-fe82-49d6-a231-c4032e3ae0ea req-bc73614e-ba8c-4b7a-a324-759e008f0214 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.951s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-036e7098-fe82-49d6-a231-c4032e3ae0ea req-bc73614e-ba8c-4b7a-a324-759e008f0214 tempest-AttachVolumeTestJSON-1084016956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-44ff69a7-b67b-480a-861d-2a15226b4247', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2285edc-96bf-41e8-ac2e-98904f05ccaf', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:03:04 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-036e7098-fe82-49d6-a231-c4032e3ae0ea req-bc73614e-ba8c-4b7a-a324-759e008f0214 tempest-AttachVolumeTestJSON-1084016956 None] attachment_update completed successfully. Jun 26 22:03:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "cinder-6da8323c-2442-47f1-ad2f-bd73e90cb3ac-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:03:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-6da8323c-2442-47f1-ad2f-bd73e90cb3ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:03:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "cinder-quobyte-6da8323c-2442-47f1-ad2f-bd73e90cb3ac" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:03:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-quobyte-6da8323c-2442-47f1-ad2f-bd73e90cb3ac" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:03:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cc3919-bd1c-4f86-9bda-f913be4f5e27]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:03:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:08 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac Jun 26 22:03:08 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:09 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac" returned: 0 in 0.821s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:09 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac Jun 26 22:03:09 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:10 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6da8323c-2442-47f1-ad2f-bd73e90cb3ac" returned: 0 in 0.928s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-quobyte-6da8323c-2442-47f1-ad2f-bd73e90cb3ac" released by "delete_volume" :: held 1.819s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Created reservations ['1bd22cf3-be8e-455e-9b0e-08d8a0ef90d0', '36881dd8-fa5c-42ec-b63c-55efb11276c9', 'ee0dc406-955a-4da0-9463-ac2de1d53ef7', '82918da7-6049-4f55-ae40-aea44b5e828b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:10 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:03:10 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "cinder-81c828f9-924d-4101-b60c-8edde1c4dfa1-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-81c828f9-924d-4101-b60c-8edde1c4dfa1-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "cinder-quobyte-81c828f9-924d-4101-b60c-8edde1c4dfa1" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-quobyte-81c828f9-924d-4101-b60c-8edde1c4dfa1" acquired by "delete_volume" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e70eae-55fa-46b1-a125-6783c925d631]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:03:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:10 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 Jun 26 22:03:10 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:11 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.031s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:11 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:03:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Deleted volume successfully. Jun 26 22:03:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9b8615b-7712-4544-8827-9ca50638bae9 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-6da8323c-2442-47f1-ad2f-bd73e90cb3ac-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:03:11 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1" returned: 0 in 1.226s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:11 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1 Jun 26 22:03:11 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:12 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-81c828f9-924d-4101-b60c-8edde1c4dfa1" returned: 0 in 0.772s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-quobyte-81c828f9-924d-4101-b60c-8edde1c4dfa1" released by "delete_volume" :: held 2.047s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Created reservations ['dbbed418-6b72-4110-bd20-39eb10338366', '5c0d9fd7-3866-4b47-8743-f653f4dc9e23', 'b386d1d1-0569-44d1-99ca-aaf101d26377', 'd4f83f53-d5d5-4c58-92fd-f276be378a38'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:12 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:03:12 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:13 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.799s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:13 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:03:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Deleted volume successfully. Jun 26 22:03:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7e7504fd-d206-4c64-b52c-4cdd6f2cbec3 tempest-ServersNegativeTestJSON-563916048 None] Lock "cinder-81c828f9-924d-4101-b60c-8edde1c4dfa1-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:03:22 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=21,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:03:23 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=23,cinder:UPDATE=25,cinder:INSERT=7,cinder:DELETE=3 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Flow 'volume_create_manager' (e2718226-9a74-4c4a-a48e-37f002a3b4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b487aa57-c0ee-4d21-a67a-a74ca5f1a35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b487aa57-c0ee-4d21-a67a-a74ca5f1a35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-855761377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49fecb9-b2fa-47e6-ad45-e876428b91b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ee40c3f08e14d1f9abf87236a92fff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:36Z,use_quota=True,user_id='860b9ca2f4b54dc08390dadf9c37abf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1811808a-666b-4598-9674-33cd4e3c99c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1811808a-666b-4598-9674-33cd4e3c99c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e992ded9-1ffe-45fa-8430-2fd5ac1e4dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e992ded9-1ffe-45fa-8430-2fd5ac1e4dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49fecb9-b2fa-47e6-ad45-e876428b91b1', 'volume_name': 'volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0eb235-cef2-4b9b-97a5-02c9cf3a4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0eb235-cef2-4b9b-97a5-02c9cf3a4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f45c30f-c947-478a-aa14-3ba6bf76d7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:36 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Volume b49fecb9-b2fa-47e6-ad45-e876428b91b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1', 'volume_size': 1} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-855761377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49fecb9-b2fa-47e6-ad45-e876428b91b1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1ee40c3f08e14d1f9abf87236a92fff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:36Z,use_quota=True,user_id='860b9ca2f4b54dc08390dadf9c37abf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Creating volume b49fecb9-b2fa-47e6-ad45-e876428b91b1 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:03:36 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:03:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:36 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 1073741824 Jun 26 22:03:36 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:38 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 1073741824" returned: 0 in 1.760s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:38 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 Jun 26 22:03:38 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:39 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1" returned: 0 in 1.279s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] <== create_volume: return (3112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:03:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.119s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f45c30f-c947-478a-aa14-3ba6bf76d7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abddcd5-83f8-4181-adfd-e943a439bb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Volume volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 (b49fecb9-b2fa-47e6-ad45-e876428b91b1): created successfully Jun 26 22:03:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abddcd5-83f8-4181-adfd-e943a439bb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Flow 'volume_create_manager' (e2718226-9a74-4c4a-a48e-37f002a3b4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:03:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-186ab3ec-a694-4788-a086-9dccf494a059 req-82eb234f-0431-4bba-9ea2-356306a68d74 tempest-VolumesGetTestJSON-1367211014 None] Created volume successfully. Jun 26 22:03:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Acquiring lock "cinder-b49fecb9-b2fa-47e6-ad45-e876428b91b1-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:03:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Lock "cinder-b49fecb9-b2fa-47e6-ad45-e876428b91b1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:03:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Acquiring lock "cinder-quobyte-b49fecb9-b2fa-47e6-ad45-e876428b91b1" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:03:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Lock "cinder-quobyte-b49fecb9-b2fa-47e6-ad45-e876428b91b1" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:03:40 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e6535c-69a0-47f2-bec2-ce96568e4d6d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:03:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:40 devstack sudo[98853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 Jun 26 22:03:40 devstack sudo[98853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:41 devstack sudo[98853]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1" returned: 0 in 0.907s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:41 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1 Jun 26 22:03:41 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:42 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b49fecb9-b2fa-47e6-ad45-e876428b91b1" returned: 0 in 0.716s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Lock "cinder-quobyte-b49fecb9-b2fa-47e6-ad45-e876428b91b1" released by "delete_volume" :: held 1.699s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG cinder.quota [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Created reservations ['aeb127a7-49d1-4fe3-bdc7-703226e018e7', 'f9717737-d225-4353-93e9-5c3a8279c74c', '4ad171fa-92c8-4558-a514-0377d58c3f82', '45c8176b-ac2e-469e-8aff-8d57634efa02'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:42 devstack sudo[98877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:03:42 devstack sudo[98877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:43 devstack sudo[98877]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.697s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:43 devstack cinder-volume[93616]: DEBUG cinder.manager [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:03:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Deleted volume successfully. Jun 26 22:03:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-6be45a1b-9898-466b-8e4b-6c48b2937602 req-e019d291-8900-45bc-84a1-0e29eda56e45 tempest-VolumesGetTestJSON-1367211014 None] Lock "cinder-b49fecb9-b2fa-47e6-ad45-e876428b91b1-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:03:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:03:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:46 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:03:46 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:47 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.739s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:03:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:03:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 8 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:03:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:03:52 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=9,cinder:UPDATE=13,cinder:INSERT=3 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:03:53 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:DELETE=2,cinder:INSERT=2 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:03:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-33fd5402-843d-4fab-b68d-b385e7aca94a req-24e2fdb8-220d-45a6-aceb-ce606d67d113 tempest-AttachVolumeTestJSON-1084016956 None] Terminate volume connection completed successfully. Jun 26 22:03:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-33fd5402-843d-4fab-b68d-b385e7aca94a req-24e2fdb8-220d-45a6-aceb-ce606d67d113 tempest-AttachVolumeTestJSON-1084016956 None] Deleting attachment d2285edc-96bf-41e8-ac2e-98904f05ccaf. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Flow 'volume_create_manager' (07846341-837f-47cb-a8b3-b823097d659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92095e6-9769-42ab-b47e-d1e1748e14db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c92095e6-9769-42ab-b47e-d1e1748e14db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-258511599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4d6552-42ca-47df-8f42-6649f9674c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c8f2eaf93f424694510ca5d2d27b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:56Z,use_quota=True,user_id='2ec150a67a414d8a89a5b89b41680067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b6df29-ee94-4c33-a1ee-ab15fa2b0681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09b6df29-ee94-4c33-a1ee-ab15fa2b0681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3651af-64ab-437b-92e6-5c9b2c9370b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3651af-64ab-437b-92e6-5c9b2c9370b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e4d6552-42ca-47df-8f42-6649f9674c51', 'volume_name': 'volume-7e4d6552-42ca-47df-8f42-6649f9674c51', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a18cb74-6077-4018-ad82-05f23753359f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a18cb74-6077-4018-ad82-05f23753359f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f393a0c-65c5-49cb-8b3e-ecb7d80af921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Volume 7e4d6552-42ca-47df-8f42-6649f9674c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e4d6552-42ca-47df-8f42-6649f9674c51', 'volume_size': 1} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-258511599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e4d6552-42ca-47df-8f42-6649f9674c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c8f2eaf93f424694510ca5d2d27b60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:56Z,use_quota=True,user_id='2ec150a67a414d8a89a5b89b41680067',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Creating volume 7e4d6552-42ca-47df-8f42-6649f9674c51 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:03:56 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:03:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:56 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 1073741824 Jun 26 22:03:56 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:58 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 1073741824" returned: 0 in 1.472s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:58 devstack sudo[99009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 Jun 26 22:03:58 devstack sudo[99009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:03:59 devstack sudo[99009]: pam_unix(sudo:session): session closed for user root Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51" returned: 0 in 0.936s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] <== create_volume: return (2482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.487s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f393a0c-65c5-49cb-8b3e-ecb7d80af921) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e4d6552-42ca-47df-8f42-6649f9674c51', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c48275-6179-4764-ac1b-584484edf9ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:59 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Volume volume-7e4d6552-42ca-47df-8f42-6649f9674c51 (7e4d6552-42ca-47df-8f42-6649f9674c51): created successfully Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99c48275-6179-4764-ac1b-584484edf9ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Flow 'volume_create_manager' (07846341-837f-47cb-a8b3-b823097d659f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:03:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ae10eb89-0226-4296-a4ce-5f26480dd72b tempest-ServerActionsTestOtherA-2049810702 None] Created volume successfully. Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Flow 'volume_create_manager' (f66be7c1-8f3f-45ab-8c1d-2d7b17c47687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81776384-2d6d-4775-b5f1-adc27a310a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81776384-2d6d-4775-b5f1-adc27a310a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1327911096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3137b633-ad6c-48bc-a818-9737bf1df9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87815b7e03d4c1daeb4fe11ac591094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:59Z,use_quota=True,user_id='9858cd53203f44e39509441674b5c6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21868de-5ae8-4952-abd9-642ce86e070c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d21868de-5ae8-4952-abd9-642ce86e070c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7e3f9e-3068-424e-8057-97dc7493f21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7e3f9e-3068-424e-8057-97dc7493f21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3137b633-ad6c-48bc-a818-9737bf1df9cb', 'volume_name': 'volume-3137b633-ad6c-48bc-a818-9737bf1df9cb', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04d71a7-0904-4be6-acf0-91a9621ab073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a04d71a7-0904-4be6-acf0-91a9621ab073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aad2d3c-2a74-4402-a40c-2d0cf6502221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:03:59 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Volume 3137b633-ad6c-48bc-a818-9737bf1df9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3137b633-ad6c-48bc-a818-9737bf1df9cb', 'volume_size': 1} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1327911096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3137b633-ad6c-48bc-a818-9737bf1df9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f87815b7e03d4c1daeb4fe11ac591094',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:03:59Z,use_quota=True,user_id='9858cd53203f44e39509441674b5c6a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Creating volume 3137b633-ad6c-48bc-a818-9737bf1df9cb {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:03:59 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:03:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:03:59 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb 1073741824 Jun 26 22:03:59 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:00 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb 1073741824" returned: 0 in 1.074s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:00 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb Jun 26 22:04:00 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:01 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb" returned: 0 in 0.835s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:04:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:04:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aad2d3c-2a74-4402-a40c-2d0cf6502221) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3137b633-ad6c-48bc-a818-9737bf1df9cb', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b38ec0-9da8-4d33-9ee4-9beedbceb13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:04:01 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Volume volume-3137b633-ad6c-48bc-a818-9737bf1df9cb (3137b633-ad6c-48bc-a818-9737bf1df9cb): created successfully Jun 26 22:04:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b38ec0-9da8-4d33-9ee4-9beedbceb13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Flow 'volume_create_manager' (f66be7c1-8f3f-45ab-8c1d-2d7b17c47687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:04:01 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-15262d44-cd5d-414b-ab92-9883395e767b tempest-AttachVolumeShelveTestJSON-653947185 None] Created volume successfully. Jun 26 22:04:11 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=4,cinder:UPDATE=6,cinder:DELETE=1,cinder:INSERT=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:04:11 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:04:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-85c22918-8d72-44db-82da-059a8678f916 req-ad1e3e0c-8942-436c-bf46-5d1ec3124ac8 tempest-AttachVolumeShelveTestJSON-653947185 None] No connector for attachment 8d5b19eb-1e9c-4525-b545-340f8b7727f6; skipping storage backend terminate_connection call. {{(pid=93616) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 26 22:04:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-85c22918-8d72-44db-82da-059a8678f916 req-ad1e3e0c-8942-436c-bf46-5d1ec3124ac8 tempest-AttachVolumeShelveTestJSON-653947185 None] Deleting attachment 8d5b19eb-1e9c-4525-b545-340f8b7727f6. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:04:36 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:04:37 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (058352d4-07a8-4f03-a089-2b73028a68a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac5b6d8-1d88-4ce9-a750-7edda3faf2a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ac5b6d8-1d88-4ce9-a750-7edda3faf2a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1753378084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5b9f8c-60b6-4b9f-ba2c-122981493eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:04:46Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f184585d-e368-4496-9165-7392eb4439c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f184585d-e368-4496-9165-7392eb4439c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7609839d-cd6e-4c36-a4c5-7dfa145df367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7609839d-cd6e-4c36-a4c5-7dfa145df367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5b9f8c-60b6-4b9f-ba2c-122981493eb4', 'volume_name': 'volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6125666-4639-4c3a-950b-d5fd1e7f5d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6125666-4639-4c3a-950b-d5fd1e7f5d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221db2b0-5d4c-43c4-8cec-80e50aea2445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:04:46 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Volume 5c5b9f8c-60b6-4b9f-ba2c-122981493eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4', 'volume_size': 1} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:04:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1753378084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5b9f8c-60b6-4b9f-ba2c-122981493eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:04:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:04:46Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Creating volume 5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:04:46 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:46 devstack sudo[99566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 1073741824 Jun 26 22:04:46 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:04:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:46 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:04:46 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:47 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.050s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 8 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:04:47 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 1073741824" returned: 0 in 1.326s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:47 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 Jun 26 22:04:47 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-701f3372-78ad-4962-a098-ddbc6e5c77ba req-29a8fb96-fa1c-486e-a4c5-cacd0b2af235 tempest-ServerActionsTestOtherA-2049810702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:04:48 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" returned: 0 in 0.874s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.252s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-701f3372-78ad-4962-a098-ddbc6e5c77ba req-29a8fb96-fa1c-486e-a4c5-cacd0b2af235 tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.788s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (221db2b0-5d4c-43c4-8cec-80e50aea2445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b13cabc-a0ba-4e86-9ad1-f1a96c63829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b5c0e0-9d25-4ec7-b819-bfe92cb671a7]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-701f3372-78ad-4962-a098-ddbc6e5c77ba req-29a8fb96-fa1c-486e-a4c5-cacd0b2af235 tempest-ServerActionsTestOtherA-2049810702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:48 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Volume volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 (5c5b9f8c-60b6-4b9f-ba2c-122981493eb4): created successfully Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b13cabc-a0ba-4e86-9ad1-f1a96c63829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:04:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (058352d4-07a8-4f03-a089-2b73028a68a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:04:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9e57ab24-5fa6-4cd9-94a0-60a97fd458d6 tempest-VolumesActionsTest-952619472 None] Created volume successfully. Jun 26 22:04:48 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 Jun 26 22:04:48 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-759a9ac8-0fde-4923-9eab-51bc447be33e tempest-VolumesActionsTest-952619472 None] Acquiring lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" by "attach_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:04:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-759a9ac8-0fde-4923-9eab-51bc447be33e tempest-VolumesActionsTest-952619472 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" acquired by "attach_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:04:49 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-759a9ac8-0fde-4923-9eab-51bc447be33e tempest-VolumesActionsTest-952619472 None] Attaching volume 5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 to instance 1da07dd3-777a-4f34-bab9-4cbbaf621361 at mountpoint /dev/vdb on host None. Jun 26 22:04:49 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-759a9ac8-0fde-4923-9eab-51bc447be33e tempest-VolumesActionsTest-952619472 None] Attach volume completed successfully. Jun 26 22:04:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-759a9ac8-0fde-4923-9eab-51bc447be33e tempest-VolumesActionsTest-952619472 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" released by "attach_volume" :: held 0.203s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:04:49 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-701f3372-78ad-4962-a098-ddbc6e5c77ba req-29a8fb96-fa1c-486e-a4c5-cacd0b2af235 tempest-ServerActionsTestOtherA-2049810702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51" returned: 0 in 1.105s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-701f3372-78ad-4962-a098-ddbc6e5c77ba req-29a8fb96-fa1c-486e-a4c5-cacd0b2af235 tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.138s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:04:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-701f3372-78ad-4962-a098-ddbc6e5c77ba req-29a8fb96-fa1c-486e-a4c5-cacd0b2af235 tempest-ServerActionsTestOtherA-2049810702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-7e4d6552-42ca-47df-8f42-6649f9674c51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3157ed1f-20ec-4042-a1e4-fba0229c6810', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:04:49 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-701f3372-78ad-4962-a098-ddbc6e5c77ba req-29a8fb96-fa1c-486e-a4c5-cacd0b2af235 tempest-ServerActionsTestOtherA-2049810702 None] attachment_update completed successfully. Jun 26 22:04:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d55a0f43-c892-42bc-8763-330f36c10319 tempest-VolumesActionsTest-622486316 None] Terminate volume connection completed successfully. Jun 26 22:04:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d55a0f43-c892-42bc-8763-330f36c10319 tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-detach_volume" by "detach_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:04:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d55a0f43-c892-42bc-8763-330f36c10319 tempest-VolumesActionsTest-622486316 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-detach_volume" acquired by "detach_volume" :: waited 0.043s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:04:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d55a0f43-c892-42bc-8763-330f36c10319 tempest-VolumesActionsTest-622486316 None] Detaching volume 5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 from instance 1da07dd3-777a-4f34-bab9-4cbbaf621361. Jun 26 22:04:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d55a0f43-c892-42bc-8763-330f36c10319 tempest-VolumesActionsTest-622486316 None] Detach volume completed successfully. Jun 26 22:04:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d55a0f43-c892-42bc-8763-330f36c10319 tempest-VolumesActionsTest-622486316 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-detach_volume" released by "detach_volume" :: held 0.130s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:04:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-45115aae-bc60-409a-a1fd-50a7cf268cc0 tempest-VolumesActionsTest-952619472 None] Acquiring lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-detach_volume" by "detach_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:04:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-45115aae-bc60-409a-a1fd-50a7cf268cc0 tempest-VolumesActionsTest-952619472 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:04:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-45115aae-bc60-409a-a1fd-50a7cf268cc0 tempest-VolumesActionsTest-952619472 None] Volume detach called, but volume not attached. Jun 26 22:04:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-45115aae-bc60-409a-a1fd-50a7cf268cc0 tempest-VolumesActionsTest-952619472 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-detach_volume" released by "detach_volume" :: held 0.026s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:04:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Acquiring lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:04:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:04:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Acquiring lock "cinder-quobyte-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:04:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Lock "cinder-quobyte-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" acquired by "delete_volume" :: waited 0.047s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:04:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3397e6c-c54a-4544-86aa-42179dbe1b3d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:04:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:54 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 Jun 26 22:04:54 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:55 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" returned: 0 in 1.508s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:55 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4 Jun 26 22:04:55 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:57 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" returned: 0 in 1.419s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Lock "cinder-quobyte-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4" released by "delete_volume" :: held 3.028s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Created reservations ['66e04e1a-1f68-4998-8240-d7b142c207fd', '53ed0aa7-cfbc-4c16-8c98-d07586aed308', '8a4a8da4-0fd7-49ce-ad9b-1942ea5d7365', '14a80165-d6cb-443a-8220-8920bf306a01'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:04:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:04:57 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:04:57 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:04:58 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Jun 26 22:04:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.130s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:04:58 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:04:58 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Deleted volume successfully. Jun 26 22:04:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8954666e-00a9-49f6-ad73-58d24307ab32 tempest-VolumesActionsTest-952619472 None] Lock "cinder-5c5b9f8c-60b6-4b9f-ba2c-122981493eb4-delete_volume" released by "delete_volume" :: held 4.553s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:01 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-3adfd5f3-7036-4efc-b9ab-e22db72f8742 tempest-ServerActionsTestOtherA-2049810702 None] Terminate volume connection completed successfully. Jun 26 22:05:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-3adfd5f3-7036-4efc-b9ab-e22db72f8742 tempest-ServerActionsTestOtherA-2049810702 None] Deleting attachment 3157ed1f-20ec-4042-a1e4-fba0229c6810. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:05:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-c18f4e70-c820-42f9-a5e3-63e5b83a10db tempest-ServerActionsTestOtherA-2049810702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-c18f4e70-c820-42f9-a5e3-63e5b83a10db tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:03 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0621b56d-e5a8-43b3-acde-87006f56bf75]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-c18f4e70-c820-42f9-a5e3-63e5b83a10db tempest-ServerActionsTestOtherA-2049810702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:03 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 Jun 26 22:05:03 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:05 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-c18f4e70-c820-42f9-a5e3-63e5b83a10db tempest-ServerActionsTestOtherA-2049810702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51" returned: 0 in 1.511s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-c18f4e70-c820-42f9-a5e3-63e5b83a10db tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.543s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-c18f4e70-c820-42f9-a5e3-63e5b83a10db tempest-ServerActionsTestOtherA-2049810702 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-7e4d6552-42ca-47df-8f42-6649f9674c51', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '505a6c03-6fb5-45e5-9b44-1611612e2d84', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:05:05 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-ec23f45f-f61f-4c2c-b231-2998913a186b req-c18f4e70-c820-42f9-a5e3-63e5b83a10db tempest-ServerActionsTestOtherA-2049810702 None] attachment_update completed successfully. Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (81cc8b86-01c0-49cf-a43f-200696d18e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424844e9-e86d-416f-9834-0e1b6c27f732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424844e9-e86d-416f-9834-0e1b6c27f732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1752363553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b49554-67be-44d8-bbcc-1eb58a28b1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:07Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64daeb7-06fd-41cf-b11e-6a4e83bd2fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d64daeb7-06fd-41cf-b11e-6a4e83bd2fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b975370-7704-407a-95cb-df87a09922fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b975370-7704-407a-95cb-df87a09922fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b49554-67be-44d8-bbcc-1eb58a28b1f7', 'volume_name': 'volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183775e2-2ed5-449b-b297-ebc432b9fac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (183775e2-2ed5-449b-b297-ebc432b9fac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb8c511-bd62-4bb5-9d48-4f08bc5a7755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:07 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Volume d3b49554-67be-44d8-bbcc-1eb58a28b1f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7', 'volume_size': 1} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1752363553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b49554-67be-44d8-bbcc-1eb58a28b1f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:07Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Creating volume d3b49554-67be-44d8-bbcc-1eb58a28b1f7 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:05:07 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:05:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:07 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 1073741824 Jun 26 22:05:07 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:08 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 1073741824" returned: 0 in 1.273s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:08 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 Jun 26 22:05:08 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:09 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7" returned: 0 in 0.821s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:05:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.183s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cb8c511-bd62-4bb5-9d48-4f08bc5a7755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755a2a3e-e00f-4bec-b684-5974f6df0a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:09 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Volume volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 (d3b49554-67be-44d8-bbcc-1eb58a28b1f7): created successfully Jun 26 22:05:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (755a2a3e-e00f-4bec-b684-5974f6df0a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (81cc8b86-01c0-49cf-a43f-200696d18e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ae80cff1-217d-4727-9120-8f8041064e9d tempest-VolumesActionsTest-952619472 None] Created volume successfully. Jun 26 22:05:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-d3b49554-67be-44d8-bbcc-1eb58a28b1f7-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Lock "cinder-d3b49554-67be-44d8-bbcc-1eb58a28b1f7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-quobyte-d3b49554-67be-44d8-bbcc-1eb58a28b1f7" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-d3b49554-67be-44d8-bbcc-1eb58a28b1f7" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:10 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9dd89e-8fb6-4cf1-8d92-217ce86bdfb4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:10 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 Jun 26 22:05:10 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:11 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7" returned: 0 in 0.903s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:11 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7 Jun 26 22:05:11 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:12 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d3b49554-67be-44d8-bbcc-1eb58a28b1f7" returned: 0 in 0.819s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-d3b49554-67be-44d8-bbcc-1eb58a28b1f7" released by "delete_volume" :: held 1.785s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Created reservations ['88f139f3-b813-41d7-af16-29bc90e0e007', 'e8a6c46b-1751-4d55-a985-3d9e5828ec6c', '538e7ecf-b3bb-4745-a925-57eb40f43748', 'b1322a7a-7326-41f4-a38d-b1fedddf9f0f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:12 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:12 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (9a776c4e-3414-4b47-98c3-0aa06c5179df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27133fa5-fd13-45d4-9161-f1d617c98302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27133fa5-fd13-45d4-9161-f1d617c98302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-811486552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc9748d-10e8-42e5-94dd-71fe9927e5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:14Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6234c309-f1e6-48a4-948a-d17c18fdd445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6234c309-f1e6-48a4-948a-d17c18fdd445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787627c0-dded-448d-a607-74d9b0bf164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (787627c0-dded-448d-a607-74d9b0bf164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc9748d-10e8-42e5-94dd-71fe9927e5c6', 'volume_name': 'volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022503bd-ce40-4251-b3c9-2242f08788bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022503bd-ce40-4251-b3c9-2242f08788bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1b0ca8-fd9c-4b25-a783-17a10260aad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:14 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Volume 8bc9748d-10e8-42e5-94dd-71fe9927e5c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6', 'volume_size': 1} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-811486552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc9748d-10e8-42e5-94dd-71fe9927e5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:14Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Creating volume 8bc9748d-10e8-42e5-94dd-71fe9927e5c6 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:05:14 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:14 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 1073741824 Jun 26 22:05:14 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:14 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.639s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:14 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Deleted volume successfully. Jun 26 22:05:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec31af3c-bede-43b4-829c-1a82470363da tempest-VolumesActionsTest-622486316 None] Lock "cinder-d3b49554-67be-44d8-bbcc-1eb58a28b1f7-delete_volume" released by "delete_volume" :: held 3.837s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:15 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 1073741824" returned: 0 in 1.294s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:15 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 Jun 26 22:05:15 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:16 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6" returned: 0 in 0.924s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:16 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:05:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.295s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:16 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb1b0ca8-fd9c-4b25-a783-17a10260aad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:16 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8029c0fd-84a2-4a65-8f5b-f81374cb15f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:16 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Volume volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 (8bc9748d-10e8-42e5-94dd-71fe9927e5c6): created successfully Jun 26 22:05:16 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8029c0fd-84a2-4a65-8f5b-f81374cb15f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:16 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (9a776c4e-3414-4b47-98c3-0aa06c5179df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:16 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1e1a802f-01a9-4187-9015-89f74df5338f tempest-VolumesActionsTest-952619472 None] Created volume successfully. Jun 26 22:05:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-8bc9748d-10e8-42e5-94dd-71fe9927e5c6-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Lock "cinder-8bc9748d-10e8-42e5-94dd-71fe9927e5c6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-quobyte-8bc9748d-10e8-42e5-94dd-71fe9927e5c6" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-8bc9748d-10e8-42e5-94dd-71fe9927e5c6" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:17 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed56c5d2-eac3-4153-b07b-7919d0acc2ca]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:17 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 Jun 26 22:05:17 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:19 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6" returned: 0 in 1.528s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:19 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6 Jun 26 22:05:19 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:20 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bc9748d-10e8-42e5-94dd-71fe9927e5c6" returned: 0 in 1.028s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-8bc9748d-10e8-42e5-94dd-71fe9927e5c6" released by "delete_volume" :: held 2.626s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Created reservations ['c6d0a49a-79c7-4f8a-a096-4a2ab546c0cb', '75761bd4-2a3e-410f-9d78-78366552cb7a', '8a0d7215-d1be-48b9-9aa6-440f5da19ecd', '6b520905-25cf-48e5-8f26-37f408330c24'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:20 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:20 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:21 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.745s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:21 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Deleted volume successfully. Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b3d889fd-9240-48b7-b9b0-069d85a94b16 tempest-VolumesActionsTest-622486316 None] Lock "cinder-8bc9748d-10e8-42e5-94dd-71fe9927e5c6-delete_volume" released by "delete_volume" :: held 3.665s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (dc46836f-1a6b-4d3e-bae3-4e2d2d62b262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1b3d4-72b9-4a2a-b2f5-1494af2284f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d1b3d4-72b9-4a2a-b2f5-1494af2284f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107651407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e162d845-5caa-42c2-8a34-892e6741655c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:21Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb8bbcf-e13c-40bd-894e-6645278a8507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cb8bbcf-e13c-40bd-894e-6645278a8507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a35161-f8ff-4daa-bc1e-79bed51175e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3a35161-f8ff-4daa-bc1e-79bed51175e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e162d845-5caa-42c2-8a34-892e6741655c', 'volume_name': 'volume-e162d845-5caa-42c2-8a34-892e6741655c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16acb2a-9bf0-46f9-9adf-b9ba0de669cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b16acb2a-9bf0-46f9-9adf-b9ba0de669cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59df5558-e48f-4a85-b628-73ca7284f43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:21 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Volume e162d845-5caa-42c2-8a34-892e6741655c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e162d845-5caa-42c2-8a34-892e6741655c', 'volume_size': 1} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2107651407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e162d845-5caa-42c2-8a34-892e6741655c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:21Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Creating volume e162d845-5caa-42c2-8a34-892e6741655c {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:05:21 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:05:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:21 devstack sudo[100974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c 1073741824 Jun 26 22:05:21 devstack sudo[100974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:22 devstack sudo[100974]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c 1073741824" returned: 0 in 0.884s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:22 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c Jun 26 22:05:22 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:23 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c" returned: 0 in 0.745s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59df5558-e48f-4a85-b628-73ca7284f43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e162d845-5caa-42c2-8a34-892e6741655c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41baf40-023a-4728-811c-e81c133091a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Volume volume-e162d845-5caa-42c2-8a34-892e6741655c (e162d845-5caa-42c2-8a34-892e6741655c): created successfully Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41baf40-023a-4728-811c-e81c133091a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (dc46836f-1a6b-4d3e-bae3-4e2d2d62b262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b7dbd525-e70d-4e89-9439-7bac65d1ab88 tempest-VolumesActionsTest-952619472 None] Created volume successfully. Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-e162d845-5caa-42c2-8a34-892e6741655c-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Lock "cinder-e162d845-5caa-42c2-8a34-892e6741655c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-quobyte-e162d845-5caa-42c2-8a34-892e6741655c" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-e162d845-5caa-42c2-8a34-892e6741655c" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d3a5ef-85aa-434f-a1f7-7e5158a65a72]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:24 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c Jun 26 22:05:24 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:24 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c" returned: 0 in 0.844s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:24 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c Jun 26 22:05:24 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:25 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e162d845-5caa-42c2-8a34-892e6741655c" returned: 0 in 0.772s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-e162d845-5caa-42c2-8a34-892e6741655c" released by "delete_volume" :: held 1.664s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Created reservations ['e4a5a907-2896-4072-8ddd-91957b336419', '38875dba-80ee-4bdc-811d-1bea72812d6b', '6f7ac1ba-6761-44ef-a4ce-4fe535140135', '2996d243-5657-4b4b-b346-4d720f84976e'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:25 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:25 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Acquiring lock "cinder-3137b633-ad6c-48bc-a818-9737bf1df9cb-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "cinder-3137b633-ad6c-48bc-a818-9737bf1df9cb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Acquiring lock "cinder-quobyte-3137b633-ad6c-48bc-a818-9737bf1df9cb" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "cinder-quobyte-3137b633-ad6c-48bc-a818-9737bf1df9cb" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[304c375a-9557-4e48-9310-7615d16e5852]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:26 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb Jun 26 22:05:26 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:26 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.130s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:26 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Deleted volume successfully. Jun 26 22:05:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-393efced-21f4-4359-a74a-1f7ef0f6bf56 tempest-VolumesActionsTest-622486316 None] Lock "cinder-e162d845-5caa-42c2-8a34-892e6741655c-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (7f4ca7ab-1dd5-4cfd-a082-883b02688739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885a4cf2-2755-4e4a-a3ba-6167d819ecb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885a4cf2-2755-4e4a-a3ba-6167d819ecb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1176196266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:27Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da9dd95-3036-4cbe-ac79-86e81eb8e9f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5da9dd95-3036-4cbe-ac79-86e81eb8e9f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8ff1c3-e235-43ec-b05b-0953445b6ebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d8ff1c3-e235-43ec-b05b-0953445b6ebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d', 'volume_name': 'volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a13ee-901f-4719-a7e6-ed335313e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71a13ee-901f-4719-a7e6-ed335313e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a5324e-ed2b-4938-b07a-be1e6c3d9be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:27 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Volume 6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d', 'volume_size': 1} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1176196266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:27Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Creating volume 6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:05:27 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:27 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d 1073741824 Jun 26 22:05:27 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:27 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb" returned: 0 in 1.270s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:27 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb Jun 26 22:05:27 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:28 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3137b633-ad6c-48bc-a818-9737bf1df9cb" returned: 0 in 0.808s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "cinder-quobyte-3137b633-ad6c-48bc-a818-9737bf1df9cb" released by "delete_volume" :: held 2.177s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Created reservations ['485a3c44-06e2-4ba1-8bc1-4c30abf57420', 'beb8a84f-cf02-4dfa-9f55-4cd7be38d047', 'c364eaa8-697f-4345-a548-ecf48bd07c69', '63283f23-6a53-4110-9b9e-dd651cda6ea8'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:05:28 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d 1073741824" returned: 0 in 1.149s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:28 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d Jun 26 22:05:28 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:28 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:28 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:29 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.680s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Deleted volume successfully. Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7177791-4ef3-43f6-bbf0-b3a2f694e44b tempest-AttachVolumeShelveTestJSON-653947185 None] Lock "cinder-3137b633-ad6c-48bc-a818-9737bf1df9cb-delete_volume" released by "delete_volume" :: held 3.259s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:29 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d" returned: 0 in 0.775s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.087s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0a5324e-ed2b-4938-b07a-be1e6c3d9be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba27ee25-c1d2-4c8e-9809-4990dea4e8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:29 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Volume volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d (6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d): created successfully Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba27ee25-c1d2-4c8e-9809-4990dea4e8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (7f4ca7ab-1dd5-4cfd-a082-883b02688739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-94ad7fb4-95b1-4804-afda-0b8e7ed0d069 tempest-VolumesActionsTest-952619472 None] Created volume successfully. Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Lock "cinder-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Acquiring lock "cinder-quobyte-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bdee71-b382-4921-a1eb-995ea94ed34e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:30 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d Jun 26 22:05:30 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Flow 'volume_create_manager' (9dbddb19-a20e-431a-9558-f45b0d7d621e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada366ca-321e-4596-b013-bfb1f4ab180e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ada366ca-321e-4596-b013-bfb1f4ab180e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-562618783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a1a3fd-54d7-4ffd-943e-1c22fd23f695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe3dbad7e674b0d93b0148933c76bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:31Z,use_quota=True,user_id='473cc2f8281f413aad0f6042032eba1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8265071-ab46-485d-be39-8489c3aa08a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8265071-ab46-485d-be39-8489c3aa08a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e744fabb-347d-4fc5-b2d3-9138356340e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e744fabb-347d-4fc5-b2d3-9138356340e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0a1a3fd-54d7-4ffd-943e-1c22fd23f695', 'volume_name': 'volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c09b7b-1f00-49c5-9fef-79440884f985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59c09b7b-1f00-49c5-9fef-79440884f985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1264454-8ba0-4ff9-9e98-39a2dc090cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:30 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Volume d0a1a3fd-54d7-4ffd-943e-1c22fd23f695: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695', 'volume_size': 1} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-562618783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0a1a3fd-54d7-4ffd-943e-1c22fd23f695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe3dbad7e674b0d93b0148933c76bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:31Z,use_quota=True,user_id='473cc2f8281f413aad0f6042032eba1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Creating volume d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:05:31 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:31 devstack sudo[101070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 1073741824 Jun 26 22:05:31 devstack sudo[101070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:31 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d" returned: 0 in 0.840s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:31 devstack sudo[101076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d Jun 26 22:05:31 devstack sudo[101076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:32 devstack sudo[101070]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 1073741824" returned: 0 in 1.025s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:32 devstack sudo[101082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 Jun 26 22:05:32 devstack sudo[101082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:32 devstack sudo[101076]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d" returned: 0 in 0.738s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Lock "cinder-quobyte-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d" released by "delete_volume" :: held 1.638s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Created reservations ['06cf98fc-9149-435a-ae56-931caf075190', '4fa3afa3-a7c6-422a-9074-9bc6ac262d68', '00d27a15-e777-4565-9fa8-9b908777a1f7', 'daaba428-4500-4be3-b157-db666304b1f1'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:32 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:32 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:32 devstack sudo[101082]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695" returned: 0 in 0.860s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] <== create_volume: return (1940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.943s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1264454-8ba0-4ff9-9e98-39a2dc090cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f1601-a88d-434a-b82b-853337c95ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:33 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Volume volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 (d0a1a3fd-54d7-4ffd-943e-1c22fd23f695): created successfully Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f58f1601-a88d-434a-b82b-853337c95ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Flow 'volume_create_manager' (9dbddb19-a20e-431a-9558-f45b0d7d621e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6c9a9da0-092a-4bff-9ecc-3c8a80dac5e9 tempest-AttachVolumeTestJSON-1084016956 None] Created volume successfully. Jun 26 22:05:33 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.912s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Deleted volume successfully. Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8dc07e71-b405-4883-892d-041440b14409 tempest-VolumesActionsTest-622486316 None] Lock "cinder-6b3f888a-b3b8-4eaa-bb47-664dc62e5e8d-delete_volume" released by "delete_volume" :: held 2.801s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (da4cf274-e675-4a54-ae3c-c393501c943f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a284067e-81e6-4a83-83f2-e26da856ea45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a284067e-81e6-4a83-83f2-e26da856ea45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-796791827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9533ab8b-6c88-4eca-9b20-9660fe627d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:33Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2a9ca3-1136-436c-8445-0f2ebe1e59c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2a9ca3-1136-436c-8445-0f2ebe1e59c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b5ba23-27b8-45d5-9271-a7bb6109fa3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9b5ba23-27b8-45d5-9271-a7bb6109fa3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9533ab8b-6c88-4eca-9b20-9660fe627d56', 'volume_name': 'volume-9533ab8b-6c88-4eca-9b20-9660fe627d56', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b1d6dd-d8cf-4dba-bf0c-4e9ddf6aed31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7b1d6dd-d8cf-4dba-bf0c-4e9ddf6aed31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87b94a1-0345-4127-a2b2-2b3972e9590b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:33 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Volume 9533ab8b-6c88-4eca-9b20-9660fe627d56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9533ab8b-6c88-4eca-9b20-9660fe627d56', 'volume_size': 1} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-796791827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9533ab8b-6c88-4eca-9b20-9660fe627d56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='948eca372078469886d94030633d68eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:33Z,use_quota=True,user_id='e0a8555c5df04492887325b5904d346d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Creating volume 9533ab8b-6c88-4eca-9b20-9660fe627d56 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:05:33 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:05:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:33 devstack sudo[101091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 1073741824 Jun 26 22:05:33 devstack sudo[101091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:34 devstack sudo[101091]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 1073741824" returned: 0 in 0.965s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:34 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 Jun 26 22:05:34 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:35 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56" returned: 0 in 0.709s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] <== create_volume: return (1720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:05:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.723s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c87b94a1-0345-4127-a2b2-2b3972e9590b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9533ab8b-6c88-4eca-9b20-9660fe627d56', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7748f15c-1701-49b6-b9fb-09230e0bec2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:35 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Volume volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 (9533ab8b-6c88-4eca-9b20-9660fe627d56): created successfully Jun 26 22:05:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7748f15c-1701-49b6-b9fb-09230e0bec2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Flow 'volume_create_manager' (da4cf274-e675-4a54-ae3c-c393501c943f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-081d99c0-da63-4434-a96b-8edaad8bdaf3 tempest-VolumesActionsTest-952619472 None] Created volume successfully. Jun 26 22:05:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Acquiring lock "cinder-9533ab8b-6c88-4eca-9b20-9660fe627d56-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Lock "cinder-9533ab8b-6c88-4eca-9b20-9660fe627d56-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Acquiring lock "cinder-quobyte-9533ab8b-6c88-4eca-9b20-9660fe627d56" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Lock "cinder-quobyte-9533ab8b-6c88-4eca-9b20-9660fe627d56" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c334a23-6bd4-452c-9117-eb83b722479c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:36 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 Jun 26 22:05:36 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:37 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=56,cinder:UPDATE=78,cinder:DELETE=7,cinder:INSERT=17 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:05:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-707877ca-a96b-427c-9770-f3c83709d1f7 req-d42a64eb-91c9-4d37-9b53-eee2fe0bfd33 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-707877ca-a96b-427c-9770-f3c83709d1f7 req-d42a64eb-91c9-4d37-9b53-eee2fe0bfd33 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8532dc7a-73eb-4173-aebd-ac955386608b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-707877ca-a96b-427c-9770-f3c83709d1f7 req-d42a64eb-91c9-4d37-9b53-eee2fe0bfd33 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:37 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 Jun 26 22:05:37 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:37 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56" returned: 0 in 1.101s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:37 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56 Jun 26 22:05:37 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:38 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-707877ca-a96b-427c-9770-f3c83709d1f7 req-d42a64eb-91c9-4d37-9b53-eee2fe0bfd33 tempest-AttachVolumeTestJSON-1084016956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695" returned: 0 in 1.011s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-707877ca-a96b-427c-9770-f3c83709d1f7 req-d42a64eb-91c9-4d37-9b53-eee2fe0bfd33 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.062s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-707877ca-a96b-427c-9770-f3c83709d1f7 req-d42a64eb-91c9-4d37-9b53-eee2fe0bfd33 tempest-AttachVolumeTestJSON-1084016956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '62eb1539-a67f-4300-88dd-69f2191a8fa4', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:05:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-707877ca-a96b-427c-9770-f3c83709d1f7 req-d42a64eb-91c9-4d37-9b53-eee2fe0bfd33 tempest-AttachVolumeTestJSON-1084016956 None] attachment_update completed successfully. Jun 26 22:05:38 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9533ab8b-6c88-4eca-9b20-9660fe627d56" returned: 0 in 0.920s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Lock "cinder-quobyte-9533ab8b-6c88-4eca-9b20-9660fe627d56" released by "delete_volume" :: held 2.088s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Created reservations ['43c51519-52d0-4446-878f-dd1d3ca19891', '1e579583-585c-4fd1-a4c1-dec3ae62953b', 'ffbed70f-73f0-4c5d-aee3-c26669949ad5', 'c5e3a599-0c21-455e-bb49-9c863a51793f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:38 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:38 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:39 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.731s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:39 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Deleted volume successfully. Jun 26 22:05:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0ab3b24a-8d03-4b4a-b1dd-ceff5ce1ec49 tempest-VolumesActionsTest-952619472 None] Lock "cinder-9533ab8b-6c88-4eca-9b20-9660fe627d56-delete_volume" released by "delete_volume" :: held 3.103s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-57debefd-dd22-424e-8eed-92c3c64f717c req-c479ab3e-9552-4a02-a680-3db9c29057fa tempest-ServerActionsTestOtherA-2049810702 None] Terminate volume connection completed successfully. Jun 26 22:05:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-57debefd-dd22-424e-8eed-92c3c64f717c req-c479ab3e-9552-4a02-a680-3db9c29057fa tempest-ServerActionsTestOtherA-2049810702 None] Deleting attachment 505a6c03-6fb5-45e5-9b44-1611612e2d84. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Flow 'volume_create_manager' (a5966d91-decf-49f4-ac33-3975769c1660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6ee0f7-240a-420b-8428-223338a4c9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc6ee0f7-240a-420b-8428-223338a4c9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1997643965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cbd4620-ebdb-45f6-996e-5321423ecb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe3dbad7e674b0d93b0148933c76bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:44Z,use_quota=True,user_id='473cc2f8281f413aad0f6042032eba1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc09d22e-5cff-4aab-ade3-a0db207477f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc09d22e-5cff-4aab-ade3-a0db207477f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca08d513-5033-4bd1-9703-9727ffa3d2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca08d513-5033-4bd1-9703-9727ffa3d2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cbd4620-ebdb-45f6-996e-5321423ecb7e', 'volume_name': 'volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44a8e3e-61c4-4992-9a7f-a45f387f45f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e44a8e3e-61c4-4992-9a7f-a45f387f45f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3734ed-2ead-44e1-950c-88eccc734b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:44 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Volume 3cbd4620-ebdb-45f6-996e-5321423ecb7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e', 'volume_size': 1} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1997643965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cbd4620-ebdb-45f6-996e-5321423ecb7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe3dbad7e674b0d93b0148933c76bfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:05:44Z,use_quota=True,user_id='473cc2f8281f413aad0f6042032eba1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Creating volume 3cbd4620-ebdb-45f6-996e-5321423ecb7e {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:05:44 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:05:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:44 devstack sudo[101152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e 1073741824 Jun 26 22:05:44 devstack sudo[101152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:45 devstack sudo[101152]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e 1073741824" returned: 0 in 1.231s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:45 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e Jun 26 22:05:45 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:46 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:46 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:46 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e" returned: 0 in 0.864s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] <== create_volume: return (2162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.166s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3734ed-2ead-44e1-950c-88eccc734b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08488772-291e-4967-87ed-ecb63a88d054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:05:46 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Volume volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e (3cbd4620-ebdb-45f6-996e-5321423ecb7e): created successfully Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08488772-291e-4967-87ed-ecb63a88d054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:05:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Flow 'volume_create_manager' (a5966d91-decf-49f4-ac33-3975769c1660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:05:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ae319fd2-90c7-47a0-b424-ce317967b50d tempest-AttachVolumeTestJSON-1084016956 None] Created volume successfully. Jun 26 22:05:47 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.053s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:05:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 8 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:05:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:05:50 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=93,cinder:INSERT=17,cinder:UPDATE=88,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:05:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-f583d9de-61b1-4e19-8423-e71e1f39567b req-372fa2d3-a763-4932-895e-d65d5f206399 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-f583d9de-61b1-4e19-8423-e71e1f39567b req-372fa2d3-a763-4932-895e-d65d5f206399 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:50 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddeb77a-6dcf-449b-a5aa-3578b7a96124]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-f583d9de-61b1-4e19-8423-e71e1f39567b req-372fa2d3-a763-4932-895e-d65d5f206399 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:50 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e Jun 26 22:05:50 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:51 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-f583d9de-61b1-4e19-8423-e71e1f39567b req-372fa2d3-a763-4932-895e-d65d5f206399 tempest-AttachVolumeTestJSON-1084016956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e" returned: 0 in 0.997s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-f583d9de-61b1-4e19-8423-e71e1f39567b req-372fa2d3-a763-4932-895e-d65d5f206399 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.024s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-f583d9de-61b1-4e19-8423-e71e1f39567b req-372fa2d3-a763-4932-895e-d65d5f206399 tempest-AttachVolumeTestJSON-1084016956 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9761d760-1188-4141-98e0-68b39b2b30e3', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:05:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-f583d9de-61b1-4e19-8423-e71e1f39567b req-372fa2d3-a763-4932-895e-d65d5f206399 tempest-AttachVolumeTestJSON-1084016956 None] attachment_update completed successfully. Jun 26 22:05:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Acquiring lock "cinder-7e4d6552-42ca-47df-8f42-6649f9674c51-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Lock "cinder-7e4d6552-42ca-47df-8f42-6649f9674c51-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Acquiring lock "cinder-quobyte-7e4d6552-42ca-47df-8f42-6649f9674c51" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:05:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Lock "cinder-quobyte-7e4d6552-42ca-47df-8f42-6649f9674c51" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:05:55 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a357fcb-6d5a-46d6-9c5a-09c995d9c43c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:05:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:55 devstack sudo[101235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 Jun 26 22:05:55 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:56 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51" returned: 0 in 0.901s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:56 devstack sudo[101241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51 Jun 26 22:05:56 devstack sudo[101241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:56 devstack sudo[101241]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7e4d6552-42ca-47df-8f42-6649f9674c51" returned: 0 in 0.731s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Lock "cinder-quobyte-7e4d6552-42ca-47df-8f42-6649f9674c51" released by "delete_volume" :: held 1.705s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:57 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Created reservations ['2c662a0f-8ce7-4123-941f-e015a06ddd61', '8bb16f6c-2134-43b8-8169-3da171d2b78c', '7778f48e-3c7e-42cb-b48f-b0212d113cb5', 'a7928ee2-b028-43ed-a033-111079d297cb'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:05:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:05:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:05:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:05:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:05:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:05:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:05:57 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:05:57 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:05:58 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Jun 26 22:05:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.313s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:05:58 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:05:58 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Deleted volume successfully. Jun 26 22:05:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cae47f8d-a8ae-4710-822e-2e859eb0e62e tempest-ServerActionsTestOtherA-2049810702 None] Lock "cinder-7e4d6552-42ca-47df-8f42-6649f9674c51-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:05:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-2b446605-43e7-40be-a8e0-f0644fe5d117 req-c9005319-22c0-4d8b-b663-c8e0bf245d18 tempest-AttachVolumeTestJSON-1084016956 None] Terminate volume connection completed successfully. Jun 26 22:05:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-2b446605-43e7-40be-a8e0-f0644fe5d117 req-c9005319-22c0-4d8b-b663-c8e0bf245d18 tempest-AttachVolumeTestJSON-1084016956 None] Deleting attachment 62eb1539-a67f-4300-88dd-69f2191a8fa4. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:06:02 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-a25fbe64-28c0-4345-bce9-b8978edacd2e req-e65a121c-9df5-47d9-92a6-5c7f46769d4d tempest-AttachVolumeTestJSON-1084016956 None] Terminate volume connection completed successfully. Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-a25fbe64-28c0-4345-bce9-b8978edacd2e req-e65a121c-9df5-47d9-92a6-5c7f46769d4d tempest-AttachVolumeTestJSON-1084016956 None] Deleting attachment 9761d760-1188-4141-98e0-68b39b2b30e3. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Flow 'volume_create_manager' (a06e0dca-0a4e-48d4-9490-73d619971f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f7bae9-f7fa-44f5-8be3-6d88c082c6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43f7bae9-f7fa-44f5-8be3-6d88c082c6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2101502444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0417e2-9539-4201-a148-c148eb0bf1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891294d636a04798845ab7469e8db909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:03Z,use_quota=True,user_id='7e13b2fd5fc5444eba53015578d5df8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226106d9-b16d-426b-89b1-56a4376506b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (226106d9-b16d-426b-89b1-56a4376506b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8606af63-d1bc-420f-8b07-e155a35084fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:02 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8606af63-d1bc-420f-8b07-e155a35084fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ee0417e2-9539-4201-a148-c148eb0bf1d2', 'volume_name': 'volume-ee0417e2-9539-4201-a148-c148eb0bf1d2', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5d9d47-8236-4082-9b37-14e1ae024920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c5d9d47-8236-4082-9b37-14e1ae024920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b9ff76-fe71-457c-a4d1-218d0f2fc2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:03 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Volume ee0417e2-9539-4201-a148-c148eb0bf1d2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ee0417e2-9539-4201-a148-c148eb0bf1d2', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Trying to clone ee0417e2-9539-4201-a148-c148eb0bf1d2 from image 57efc2e5-cc7c-4583-b444-d036b0944149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:06:03 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Image download 20.69 MB at 20.69 MB/s Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1583be5b-7f4a-4bdb-9f51-6e57c4d67e71]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:03 devstack sudo[101390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD Jun 26 22:06:03 devstack sudo[101390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:04 devstack sudo[101390]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD" returned: 0 in 0.854s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:04 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 is fetched for user 7e13b2fd5fc5444eba53015578d5df8e. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:06:04 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee9d18f-8d12-4422-a2f9-82764335833e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:04 devstack sudo[101396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD Jun 26 22:06:04 devstack sudo[101396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:05 devstack sudo[101396]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD" returned: 0 in 0.919s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-2101502444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee0417e2-9539-4201-a148-c148eb0bf1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='891294d636a04798845ab7469e8db909',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:03Z,use_quota=True,user_id='7e13b2fd5fc5444eba53015578d5df8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Creating volume ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:05 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:05 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 1073741824 Jun 26 22:06:05 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:07 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 1073741824" returned: 0 in 1.483s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:07 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 Jun 26 22:06:07 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:08 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2" returned: 0 in 1.056s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] <== create_volume: return (2673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.681s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:08 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Attempting download of 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume ee0417e2-9539-4201-a148-c148eb0bf1d2. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:06:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8624cec-a463-4499-a4f6-a0e97dbeaad2]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_udcw9jjp {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:08 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_udcw9jjp Jun 26 22:06:08 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:09 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_udcw9jjp" returned: 0 in 1.473s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_udcw9jjp {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:10 devstack sudo[101563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_udcw9jjp Jun 26 22:06:10 devstack sudo[101563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:10 devstack sudo[101563]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_udcw9jjp" returned: 1 in 0.985s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_udcw9jjp' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:06:10 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18e25fc-541c-4325-8fe3-d296e1fcb16f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:11 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD Jun 26 22:06:11 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:12 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD" returned: 0 in 1.091s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:12 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] 57efc2e5-cc7c-4583-b444-d036b0944149 was qcow2, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:06:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:12 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 Jun 26 22:06:12 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:14 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2" returned: 0 in 2.808s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:14 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_845ri2tsdevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:06:14 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Converted 112.00 MB image at 39.81 MB/s Jun 26 22:06:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:14 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 1G Jun 26 22:06:14 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:15 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 1G" returned: 0 in 1.035s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c6e174-5b7b-478a-abdd-39317f949f06]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:16 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 Jun 26 22:06:16 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "cinder-3cbd4620-ebdb-45f6-996e-5321423ecb7e-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-3cbd4620-ebdb-45f6-996e-5321423ecb7e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "cinder-quobyte-3cbd4620-ebdb-45f6-996e-5321423ecb7e" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-quobyte-3cbd4620-ebdb-45f6-996e-5321423ecb7e" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:16 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[39717b07-2a3a-4c1e-870d-79f225c8a5a5]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:16 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e Jun 26 22:06:16 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:17 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2" returned: 0 in 1.084s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:17 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 Jun 26 22:06:17 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:17 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e" returned: 0 in 0.889s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:17 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e Jun 26 22:06:17 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:17 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2" returned: 1 in 0.884s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Downloaded image 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume ee0417e2-9539-4201-a148-c148eb0bf1d2 successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 for user 7e13b2fd5fc5444eba53015578d5df8e is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Marking volume ee0417e2-9539-4201-a148-c148eb0bf1d2 as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Copying metadata from image 57efc2e5-cc7c-4583-b444-d036b0944149 to ee0417e2-9539-4201-a148-c148eb0bf1d2. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:06:17 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Creating volume glance metadata for volume ee0417e2-9539-4201-a148-c148eb0bf1d2 backed by image 57efc2e5-cc7c-4583-b444-d036b0944149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54b9ff76-fe71-457c-a4d1-218d0f2fc2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee0417e2-9539-4201-a148-c148eb0bf1d2', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32651a0-13d2-4552-8fa2-bfa6aa93b440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:18 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Volume volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 (ee0417e2-9539-4201-a148-c148eb0bf1d2): created successfully Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32651a0-13d2-4552-8fa2-bfa6aa93b440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Flow 'volume_create_manager' (a06e0dca-0a4e-48d4-9490-73d619971f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-49405431-5b58-4227-9868-d68a87e398de tempest-VolumesImageMetadata-887482613 None] Created volume successfully. Jun 26 22:06:18 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3cbd4620-ebdb-45f6-996e-5321423ecb7e" returned: 0 in 0.969s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-quobyte-3cbd4620-ebdb-45f6-996e-5321423ecb7e" released by "delete_volume" :: held 1.907s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Created reservations ['08ed1058-6e76-486a-9307-7ee388a5083b', '25157d58-e36b-4dca-9b6c-a20f96c29b12', '345793a5-f59c-49f2-8286-e62f8fd9e2fc', '3a5697d5-4313-48bc-bf60-f73f0ec807c0'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Flow 'volume_create_manager' (87d07ea4-4358-41e1-af9f-c327c3f69aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdca4c3e-9b35-4b45-a1fa-b446d094669e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdca4c3e-9b35-4b45-a1fa-b446d094669e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-647816935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c630c2ba-0072-45df-b89a-f4f6ab97189d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ee949cbaa468a8698d1eed21d3c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:18Z,use_quota=True,user_id='49a313bf0bfc48f8b90df3513e0db564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eb011b-c03b-452c-8a57-9ac75821e164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0eb011b-c03b-452c-8a57-9ac75821e164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d177f12-c7ba-451d-86a8-f7ab668be480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d177f12-c7ba-451d-86a8-f7ab668be480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c630c2ba-0072-45df-b89a-f4f6ab97189d', 'volume_name': 'volume-c630c2ba-0072-45df-b89a-f4f6ab97189d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1393c98f-4128-41bb-8b7a-b41299fab643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1393c98f-4128-41bb-8b7a-b41299fab643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca265062-48b9-4964-980c-1acbad4b0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:18 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Volume c630c2ba-0072-45df-b89a-f4f6ab97189d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c630c2ba-0072-45df-b89a-f4f6ab97189d', 'volume_size': 1} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-647816935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c630c2ba-0072-45df-b89a-f4f6ab97189d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1ee949cbaa468a8698d1eed21d3c86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:18Z,use_quota=True,user_id='49a313bf0bfc48f8b90df3513e0db564',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Creating volume c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:18 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:18 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d 1073741824 Jun 26 22:06:18 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:18 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:18 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "cinder-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Acquiring lock "cinder-ee0417e2-9539-4201-a148-c148eb0bf1d2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Lock "cinder-ee0417e2-9539-4201-a148-c148eb0bf1d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "cinder-quobyte-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-quobyte-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695" acquired by "delete_volume" :: waited 0.047s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Acquiring lock "cinder-quobyte-ee0417e2-9539-4201-a148-c148eb0bf1d2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[47f27f5c-eb1f-42fd-8a03-307f408ee055]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Lock "cinder-quobyte-ee0417e2-9539-4201-a148-c148eb0bf1d2" acquired by "delete_volume" :: waited 0.057s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8109a3c-4fb2-4043-b099-2f2d1a744b45]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:19 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 Jun 26 22:06:19 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:19 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 Jun 26 22:06:19 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:19 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.148s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:19 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Deleted volume successfully. Jun 26 22:06:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6682c96-48d1-42ed-a8a7-2eebbf4a7029 tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-3cbd4620-ebdb-45f6-996e-5321423ecb7e-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:20 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695" returned: 0 in 1.077s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:20 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695 Jun 26 22:06:20 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:20 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d 1073741824" returned: 0 in 1.655s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:20 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2" returned: 0 in 1.271s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:20 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d Jun 26 22:06:20 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:20 devstack sudo[101648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 Jun 26 22:06:20 devstack sudo[101648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:20 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695" returned: 0 in 0.799s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-quobyte-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695" released by "delete_volume" :: held 1.956s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:20 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Created reservations ['3eb0f4ce-6dc2-4d8e-9c00-3b1fa5a08da8', '13ec3ffa-96e5-462e-b80d-c0ab45a32a34', '653d8c21-5ece-4459-aa1c-fe8f9b4fe7c2', '4e47ab73-271a-469d-9769-c37ccf0e30e6'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:21 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:21 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:21 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d" returned: 0 in 0.751s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] <== create_volume: return (2505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca265062-48b9-4964-980c-1acbad4b0540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c630c2ba-0072-45df-b89a-f4f6ab97189d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23986a8-847f-481d-a613-da2c815e97b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:21 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Volume volume-c630c2ba-0072-45df-b89a-f4f6ab97189d (c630c2ba-0072-45df-b89a-f4f6ab97189d): created successfully Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b23986a8-847f-481d-a613-da2c815e97b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Flow 'volume_create_manager' (87d07ea4-4358-41e1-af9f-c327c3f69aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:21 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-3a45b588-9d48-4efe-a964-3454d3a1d515 req-ccd846f8-038a-4e4b-8d1e-5dc0a9bbfea6 tempest-VolumesSnapshotsTestJSON-2046705791 None] Created volume successfully. Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "cinder-44ff69a7-b67b-480a-861d-2a15226b4247-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:21 devstack sudo[101648]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2" returned: 1 in 0.911s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-44ff69a7-b67b-480a-861d-2a15226b4247-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:21 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2 Jun 26 22:06:21 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "cinder-quobyte-44ff69a7-b67b-480a-861d-2a15226b4247" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-quobyte-44ff69a7-b67b-480a-861d-2a15226b4247" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46f22e-f4d3-4244-ba48-b4d5e62f48eb]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:21 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 Jun 26 22:06:21 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:21 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.702s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:21 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Deleted volume successfully. Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-555d3d1f-7f31-4a47-96f4-a19e2e4d3afb tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-d0a1a3fd-54d7-4ffd-943e-1c22fd23f695-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:21 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ee0417e2-9539-4201-a148-c148eb0bf1d2" returned: 0 in 0.691s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Lock "cinder-quobyte-ee0417e2-9539-4201-a148-c148eb0bf1d2" released by "delete_volume" :: held 2.972s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Created reservations ['23549c88-de4a-45a7-bece-97b5a8e513df', 'a5b52463-32c2-4322-b590-70b15d6cf6ce', 'c5fb880b-d6b7-42fb-b996-b7b57cc2bd4b', '941d3749-9536-47bd-bc30-6ce8c87149f9'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:22 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:22 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Creating offline snapshot eeefc3a8-1f77-4e28-94a1-ebc171efbcad of volume c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:06:22 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247" returned: 0 in 0.891s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8b9729-74ba-4da2-a429-dba76c2a0ba1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:22 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247 Jun 26 22:06:22 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:22 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d Jun 26 22:06:22 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:23 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.875s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Deleted volume successfully. Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-86176c38-3808-47ce-9d8a-5104e92f6a07 tempest-VolumesImageMetadata-887482613 None] Lock "cinder-ee0417e2-9539-4201-a148-c148eb0bf1d2-delete_volume" released by "delete_volume" :: held 4.236s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:23 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44ff69a7-b67b-480a-861d-2a15226b4247" returned: 0 in 0.888s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-quobyte-44ff69a7-b67b-480a-861d-2a15226b4247" released by "delete_volume" :: held 1.831s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:23 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d" returned: 0 in 0.936s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:23 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad 1G Jun 26 22:06:23 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Created reservations ['f98fa4a8-c707-42a1-9856-ee35162049af', 'bc752460-a281-46db-83ab-a9a1e248d3f5', '711b583b-bbc2-4102-b5af-a6dd08d9d355', '47979aea-2e09-4dfd-bba2-3caf511b413c'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:23 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:23 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:24 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.819s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:24 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Deleted volume successfully. Jun 26 22:06:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-89b4d138-b5c2-4b87-9b8d-11589943f9cf tempest-AttachVolumeTestJSON-1084016956 None] Lock "cinder-44ff69a7-b67b-480a-861d-2a15226b4247-delete_volume" released by "delete_volume" :: held 2.933s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:24 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad 1G" returned: 0 in 1.076s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c630c2ba-0072-45df-b89a-f4f6ab97189d -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:24 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c630c2ba-0072-45df-b89a-f4f6ab97189d -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad Jun 26 22:06:24 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:25 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c630c2ba-0072-45df-b89a-f4f6ab97189d -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad" returned: 0 in 0.850s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:25 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad is being set with open permissions: ugo+rw Jun 26 22:06:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:25 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad Jun 26 22:06:25 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:25 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad" returned: 0 in 0.788s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:26 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.info Jun 26 22:06:26 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:26 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.info" returned: 0 in 0.934s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:26 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.info is being set with open permissions: ugo+rw Jun 26 22:06:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:26 devstack sudo[101704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.info Jun 26 22:06:26 devstack sudo[101704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:27 devstack sudo[101704]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.info" returned: 0 in 0.838s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.591s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:27 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-c33bd937-2ed2-4c60-859f-660adc543e82 req-427eacab-651d-4359-a04b-3a2aa5220fdd tempest-VolumesSnapshotsTestJSON-2046705791 None] Create snapshot completed successfully Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "cinder-eeefc3a8-1f77-4e28-94a1-ebc171efbcad-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-eeefc3a8-1f77-4e28-94a1-ebc171efbcad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "cinder-quobyte-c630c2ba-0072-45df-b89a-f4f6ab97189d" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-quobyte-c630c2ba-0072-45df-b89a-f4f6ab97189d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "cinder-quobyte-eeefc3a8-1f77-4e28-94a1-ebc171efbcad" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-quobyte-eeefc3a8-1f77-4e28-94a1-ebc171efbcad" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Deleting offline snapshot eeefc3a8-1f77-4e28-94a1-ebc171efbcad of volume c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] snapshot_file for this snap is: volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f858267f-b227-4a7f-a0ab-3dbe854ebd9e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:28 devstack sudo[101708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad Jun 26 22:06:28 devstack sudo[101708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:29 devstack sudo[101708]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad" returned: 0 in 1.151s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c630c2ba-0072-45df-b89a-f4f6ab97189d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:06:29 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef3e552-080c-4f2e-afe8-47b0e9a0cb0b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:29 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d Jun 26 22:06:29 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Flow 'volume_create_manager' (39118c5e-eb1f-41c9-99e1-ced2c807f038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29ba269-c7fb-437b-a035-ddf670f34c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29ba269-c7fb-437b-a035-ddf670f34c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1791409498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7333e5a0-f408-4fa9-a8fb-8ea50a241ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5564df88824544c9bd2ffd71c1a5b844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:30Z,use_quota=True,user_id='0dc05e4f393d4dac9928cfe8a75a73a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5629eabf-56c4-4239-80e0-45c0ecf5d1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5629eabf-56c4-4239-80e0-45c0ecf5d1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f53ab55-51a7-4311-9592-85bcfb387ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f53ab55-51a7-4311-9592-85bcfb387ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7333e5a0-f408-4fa9-a8fb-8ea50a241ca5', 'volume_name': 'volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec75212a-3482-48dd-8847-7ca85ca563c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec75212a-3482-48dd-8847-7ca85ca563c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e3f6d3-c3af-4df5-b997-0cb457b1103b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:30 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Volume 7333e5a0-f408-4fa9-a8fb-8ea50a241ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5', 'volume_size': 1} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1791409498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7333e5a0-f408-4fa9-a8fb-8ea50a241ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5564df88824544c9bd2ffd71c1a5b844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:30Z,use_quota=True,user_id='0dc05e4f393d4dac9928cfe8a75a73a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Creating volume 7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:30 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:30 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d" returned: 0 in 0.976s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:30 devstack sudo[101719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 1073741824 Jun 26 22:06:30 devstack sudo[101719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:30 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad Jun 26 22:06:30 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:31 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad" returned: 0 in 0.762s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:31 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad Jun 26 22:06:31 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:31 devstack sudo[101719]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 1073741824" returned: 0 in 0.880s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:31 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 Jun 26 22:06:31 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:31 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d.eeefc3a8-1f77-4e28-94a1-ebc171efbcad" returned: 0 in 0.689s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-quobyte-eeefc3a8-1f77-4e28-94a1-ebc171efbcad" released by "_delete_snapshot" :: held 3.732s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-quobyte-c630c2ba-0072-45df-b89a-f4f6ab97189d" released by "delete_snapshot" :: held 3.764s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:31 devstack cinder-volume[93616]: WARNING cinder.quota [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG cinder.quota [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Created reservations ['1a5cbff2-6cf4-47fb-9d76-6b1762e48f5c', '511dd7dd-2d73-496a-918c-5486c3b71d66', 'c9214892-296f-48f1-82b6-76badeadb69f', '029edf75-cb9f-4149-8cc6-0dc0f94bdec9'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:31 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5" returned: 0 in 0.673s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e3f6d3-c3af-4df5-b997-0cb457b1103b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2b1852-91ae-4137-aa9b-8020c71e129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Volume volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 (7333e5a0-f408-4fa9-a8fb-8ea50a241ca5): created successfully Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab2b1852-91ae-4137-aa9b-8020c71e129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Flow 'volume_create_manager' (39118c5e-eb1f-41c9-99e1-ced2c807f038) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:32 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f8b83eb6-7534-4696-a5b9-e96eedf539cb tempest-AbsoluteLimitsTests-2116301386 None] Created volume successfully. Jun 26 22:06:32 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Delete snapshot completed successfully. Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-59f5c72f-19de-4401-806e-d0e99b9ffd29 req-c863d400-8418-4429-ba3f-bb21a520d203 tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-eeefc3a8-1f77-4e28-94a1-ebc171efbcad-delete_snapshot" released by "delete_snapshot" :: held 3.964s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Acquiring lock "cinder-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Lock "cinder-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "cinder-c630c2ba-0072-45df-b89a-f4f6ab97189d-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Acquiring lock "cinder-quobyte-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-c630c2ba-0072-45df-b89a-f4f6ab97189d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Lock "cinder-quobyte-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab84344a-9f18-44ac-9e29-d86fe9e89932]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "cinder-quobyte-c630c2ba-0072-45df-b89a-f4f6ab97189d" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-quobyte-c630c2ba-0072-45df-b89a-f4f6ab97189d" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc50c8d-e100-4a06-9338-831fe95a3de4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:32 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 Jun 26 22:06:32 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:32 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d Jun 26 22:06:32 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:33 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5" returned: 0 in 0.994s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:33 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d" returned: 0 in 0.931s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:33 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5 Jun 26 22:06:33 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:33 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d Jun 26 22:06:33 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:33 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Flow 'volume_create_manager' (5d7b2104-5525-43af-94ee-08224572bd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7573e7df-7bea-477f-83e3-2410aa7419ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7573e7df-7bea-477f-83e3-2410aa7419ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-551594698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd76c22-949f-4d4c-8ded-d71e65747f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a299290e62df4e21a2fc75c62482cbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:34Z,use_quota=True,user_id='48d9ae853db64a83bbbc1591d0154503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcd47ca-0bc0-49b6-812a-c621ed732c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edcd47ca-0bc0-49b6-812a-c621ed732c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e072004-9133-4b21-81be-458020130809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e072004-9133-4b21-81be-458020130809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bd76c22-949f-4d4c-8ded-d71e65747f8f', 'volume_name': 'volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123eb21f-3499-4be9-889b-6ae56c92dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (123eb21f-3499-4be9-889b-6ae56c92dedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101c4150-1ce6-4111-8161-0302481066f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:34 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Volume 8bd76c22-949f-4d4c-8ded-d71e65747f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f', 'volume_size': 1} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-551594698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bd76c22-949f-4d4c-8ded-d71e65747f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a299290e62df4e21a2fc75c62482cbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:34Z,use_quota=True,user_id='48d9ae853db64a83bbbc1591d0154503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Creating volume 8bd76c22-949f-4d4c-8ded-d71e65747f8f {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:34 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:34 devstack sudo[101755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f 1073741824 Jun 26 22:06:34 devstack sudo[101755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:34 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c630c2ba-0072-45df-b89a-f4f6ab97189d" returned: 0 in 0.781s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:34 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5" returned: 0 in 0.812s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-quobyte-c630c2ba-0072-45df-b89a-f4f6ab97189d" released by "delete_volume" :: held 1.787s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Lock "cinder-quobyte-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5" released by "delete_volume" :: held 1.877s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.quota [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Created reservations ['dc34bdf0-b1ca-4d31-a93b-59615cee0036', '5243a243-e93d-4cb0-8a98-a17bb99feb1c', '4b360933-ef19-411f-a2d8-1c5e3e112194', '8a3ca856-c7d1-4e33-997f-2c13ca266ea5'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Created reservations ['4f1a4cf0-de88-4b52-92bb-0693ff878816', 'b72be6cb-80e3-4631-b60a-55468ab8f36b', '88267967-a8c6-462a-85e7-da2633cc5813', 'ff5831bf-2941-4af7-bda3-09fecc1f0388'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:34 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:34 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:34 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:34 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:35 devstack sudo[101755]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f 1073741824" returned: 0 in 1.348s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:35 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f Jun 26 22:06:35 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:35 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.888s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG cinder.manager [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Deleted volume successfully. Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-45882852-ce06-4df7-a654-8eff005a0016 req-312024a3-2eb3-4d57-a534-7498a2399e4a tempest-VolumesSnapshotsTestJSON-2046705791 None] Lock "cinder-c630c2ba-0072-45df-b89a-f4f6ab97189d-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:35 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.015s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Deleted volume successfully. Jun 26 22:06:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-236090e8-6395-4d30-bee3-ebcc5076a0d3 tempest-AbsoluteLimitsTests-2116301386 None] Lock "cinder-7333e5a0-f408-4fa9-a8fb-8ea50a241ca5-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:36 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f" returned: 0 in 0.752s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.168s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101c4150-1ce6-4111-8161-0302481066f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31010e0-730c-43c8-9b28-658a53ae6dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:36 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Volume volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f (8bd76c22-949f-4d4c-8ded-d71e65747f8f): created successfully Jun 26 22:06:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31010e0-730c-43c8-9b28-658a53ae6dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Flow 'volume_create_manager' (5d7b2104-5525-43af-94ee-08224572bd1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:36 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-200a61cf-36ef-4c93-a986-d6888ce8f61e tempest-AttachVolumeNegativeTest-1350716939 None] Created volume successfully. Jun 26 22:06:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f1b9a83c-15ae-4f31-8e0e-622445d8d661 tempest-BackendsCapabilitiesAdminTestsJSON-338353447 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6863327026367, 'free_capacity_gb': 1775.6863327026367, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93616) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 26 22:06:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-cf7f0d18-129b-4de2-a428-fb7aa4a86d44 tempest-BackendsCapabilitiesAdminTestsJSON-338353447 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6863327026367, 'free_capacity_gb': 1775.6863327026367, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93616) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 26 22:06:40 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=73,cinder:UPDATE=89,cinder:INSERT=27,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:06:41 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-eb20371f-a34d-4b96-a087-6c38aa29e3e5 tempest-GroupSnapshotsTest-1698552620 None] Group tempest-GroupSnapshotsTest-Group-874515335: creating Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Flow 'volume_create_manager' (ea0dd209-cc40-471a-a473-b4d40a0fec9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19298b78-db93-4339-a386-25b1da5c584c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19298b78-db93-4339-a386-25b1da5c584c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-602708713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e23a118-a488-4247-8d8c-03fa42dc71f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0c492a5b884b32b1e305a0c8b48c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:41Z,use_quota=True,user_id='667dbd631fed466aa87c8db43bcfb678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f291111d-53db-49a2-87e2-5bb086b6910e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f291111d-53db-49a2-87e2-5bb086b6910e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d233264-a613-4f23-95a7-67208e784707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d233264-a613-4f23-95a7-67208e784707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e23a118-a488-4247-8d8c-03fa42dc71f3', 'volume_name': 'volume-6e23a118-a488-4247-8d8c-03fa42dc71f3', 'volume_size': 2}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcf3310-44e4-4831-a329-3dc20df421d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddcf3310-44e4-4831-a329-3dc20df421d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c495a7b-02c8-415e-9a4b-06c8a0b413cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:41 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Volume 6e23a118-a488-4247-8d8c-03fa42dc71f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e23a118-a488-4247-8d8c-03fa42dc71f3', 'volume_size': 2} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-602708713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e23a118-a488-4247-8d8c-03fa42dc71f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de0c492a5b884b32b1e305a0c8b48c77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:41Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:41Z,use_quota=True,user_id='667dbd631fed466aa87c8db43bcfb678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Creating volume 6e23a118-a488-4247-8d8c-03fa42dc71f3 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:41 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 2147483648 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-645c0650-85d0-43bc-ac40-11bffa923642 req-e81e5da2-8e61-4605-ba86-e3874e414fc7 tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:41 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-eb20371f-a34d-4b96-a087-6c38aa29e3e5 tempest-GroupSnapshotsTest-1698552620 None] Group tempest-GroupSnapshotsTest-Group-874515335: created successfully Jun 26 22:06:41 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 2147483648 Jun 26 22:06:41 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:41 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-eb20371f-a34d-4b96-a087-6c38aa29e3e5 tempest-GroupSnapshotsTest-1698552620 None] Create group completed successfully. Jun 26 22:06:42 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 2147483648" returned: 0 in 0.995s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:42 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 Jun 26 22:06:42 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (215c00e5-a279-4714-85e8-c83dcfe7c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fec5d29-d049-4072-8eca-06140fd7151b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fec5d29-d049-4072-8eca-06140fd7151b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669812113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c06b18ce-00fb-4fe4-942a-8a94e66cfd70,host='devstack@QuobyteHD#QuobyteHD',id=63822ea5-1135-43ba-90c1-6af36ff805c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:42Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(556ee2b4-a16e-422f-b3d7-d2fe0dc6b4b2),volume_type_id=556ee2b4-a16e-422f-b3d7-d2fe0dc6b4b2)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a5851f-3987-4417-8c61-a02ed05e042c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8a5851f-3987-4417-8c61-a02ed05e042c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f93daa-0b54-478c-9ac1-228ee0754a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42f93daa-0b54-478c-9ac1-228ee0754a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63822ea5-1135-43ba-90c1-6af36ff805c2', 'volume_name': 'volume-63822ea5-1135-43ba-90c1-6af36ff805c2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25796697-678e-404f-b72e-e0d95d013ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25796697-678e-404f-b72e-e0d95d013ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3908bc57-5520-4562-915c-5fd8b2241bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:42 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Volume 63822ea5-1135-43ba-90c1-6af36ff805c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63822ea5-1135-43ba-90c1-6af36ff805c2', 'volume_size': 1} Jun 26 22:06:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:43 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3" returned: 0 in 0.812s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-645c0650-85d0-43bc-ac40-11bffa923642 req-e81e5da2-8e61-4605-ba86-e3874e414fc7 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.827s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c495a7b-02c8-415e-9a4b-06c8a0b413cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e23a118-a488-4247-8d8c-03fa42dc71f3', 'volume_size': 2}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2999e2-bf1e-4597-9bcc-f58017a104da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b82205-74ec-4ed5-a896-4dd7eabbf963]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-645c0650-85d0-43bc-ac40-11bffa923642 req-e81e5da2-8e61-4605-ba86-e3874e414fc7 tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:43 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Volume volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 (6e23a118-a488-4247-8d8c-03fa42dc71f3): created successfully Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa2999e2-bf1e-4597-9bcc-f58017a104da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Flow 'volume_create_manager' (ea0dd209-cc40-471a-a473-b4d40a0fec9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-45b73e3f-6cb2-45f2-bdc6-a6abe9f0f9a9 tempest-VolumesCloneNegativeTest-191777823 None] Created volume successfully. Jun 26 22:06:43 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f Jun 26 22:06:43 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:43 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-645c0650-85d0-43bc-ac40-11bffa923642 req-e81e5da2-8e61-4605-ba86-e3874e414fc7 tempest-AttachVolumeNegativeTest-1350716939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f" returned: 0 in 0.776s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-645c0650-85d0-43bc-ac40-11bffa923642 req-e81e5da2-8e61-4605-ba86-e3874e414fc7 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.805s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c06b18ce-00fb-4fe4-942a-8a94e66cfd70,created_at=2026-06-26T20:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-669812113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c06b18ce-00fb-4fe4-942a-8a94e66cfd70,host='devstack@QuobyteHD#QuobyteHD',id=63822ea5-1135-43ba-90c1-6af36ff805c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:42Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(556ee2b4-a16e-422f-b3d7-d2fe0dc6b4b2),volume_type_id=556ee2b4-a16e-422f-b3d7-d2fe0dc6b4b2)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Creating volume 63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:43 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:43 devstack sudo[101807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 1073741824 Jun 26 22:06:43 devstack sudo[101807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-645c0650-85d0-43bc-ac40-11bffa923642 req-e81e5da2-8e61-4605-ba86-e3874e414fc7 tempest-AttachVolumeNegativeTest-1350716939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a2a6666-f1f4-4ee8-8cf9-9f73558c8f94', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:06:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-645c0650-85d0-43bc-ac40-11bffa923642 req-e81e5da2-8e61-4605-ba86-e3874e414fc7 tempest-AttachVolumeNegativeTest-1350716939 None] attachment_update completed successfully. Jun 26 22:06:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-89288caf-4da3-4327-a1d9-1fcdc36a1d11 tempest-GroupSnapshotsV319Test-1466381588 None] Group tempest-GroupSnapshotsV319Test-Group-897783514: creating Jun 26 22:06:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-89288caf-4da3-4327-a1d9-1fcdc36a1d11 tempest-GroupSnapshotsV319Test-1466381588 None] Group tempest-GroupSnapshotsV319Test-Group-897783514: created successfully Jun 26 22:06:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-89288caf-4da3-4327-a1d9-1fcdc36a1d11 tempest-GroupSnapshotsV319Test-1466381588 None] Create group completed successfully. Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Acquiring lock "cinder-6e23a118-a488-4247-8d8c-03fa42dc71f3-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Lock "cinder-6e23a118-a488-4247-8d8c-03fa42dc71f3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Acquiring lock "cinder-quobyte-6e23a118-a488-4247-8d8c-03fa42dc71f3" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Lock "cinder-quobyte-6e23a118-a488-4247-8d8c-03fa42dc71f3" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[987aeb53-4f62-4254-86ec-07b147f7de42]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:44 devstack sudo[101807]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:44 devstack sudo[101836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 Jun 26 22:06:44 devstack sudo[101836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 1073741824" returned: 0 in 0.885s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:44 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 Jun 26 22:06:44 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:45 devstack sudo[101836]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3" returned: 0 in 0.812s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:45 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3 Jun 26 22:06:45 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:45 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2" returned: 0 in 0.703s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3908bc57-5520-4562-915c-5fd8b2241bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63822ea5-1135-43ba-90c1-6af36ff805c2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5f1f23-78a2-46d4-b421-1d56b88a27e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:45 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Volume volume-63822ea5-1135-43ba-90c1-6af36ff805c2 (63822ea5-1135-43ba-90c1-6af36ff805c2): created successfully Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f5f1f23-78a2-46d4-b421-1d56b88a27e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (215c00e5-a279-4714-85e8-c83dcfe7c652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:45 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-23954e0b-5570-437c-b75e-60fcd9c559bc tempest-GroupSnapshotsTest-1698552620 None] Created volume successfully. Jun 26 22:06:46 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6e23a118-a488-4247-8d8c-03fa42dc71f3" returned: 0 in 0.707s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Lock "cinder-quobyte-6e23a118-a488-4247-8d8c-03fa42dc71f3" released by "delete_volume" :: held 1.568s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Flow 'volume_create_manager' (baf8b47f-1f5b-4fc1-8769-d1782286508e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636b49aa-513c-447b-a94d-69a810716dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636b49aa-513c-447b-a94d-69a810716dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1840512914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7552079-70af-42aa-8315-61ab73ec6600,host='devstack@QuobyteHD#QuobyteHD',id=3f09f86d-c25d-455a-a829-b1b5db6d3078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea4dfff4ae04b518b1a10d1c4f5ef89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:46Z,use_quota=True,user_id='26dd01433c0848ba84bcab2e19ae3fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88dbc1df-b1d0-49d4-b722-35dd6ef0aae6),volume_type_id=88dbc1df-b1d0-49d4-b722-35dd6ef0aae6)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f55a433-6a1e-4015-a8a0-13b8e6b5fe55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f55a433-6a1e-4015-a8a0-13b8e6b5fe55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc6a883-4924-4c34-8abf-2491defc5eaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc6a883-4924-4c34-8abf-2491defc5eaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f09f86d-c25d-455a-a829-b1b5db6d3078', 'volume_name': 'volume-3f09f86d-c25d-455a-a829-b1b5db6d3078', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d79a6d5-f3f1-4e73-904e-68191b84b740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d79a6d5-f3f1-4e73-904e-68191b84b740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04ad28f-1b7c-4a55-910e-a3f1916b9e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:46 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Volume 3f09f86d-c25d-455a-a829-b1b5db6d3078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f09f86d-c25d-455a-a829-b1b5db6d3078', 'volume_size': 1} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7552079-70af-42aa-8315-61ab73ec6600,created_at=2026-06-26T20:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1840512914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7552079-70af-42aa-8315-61ab73ec6600,host='devstack@QuobyteHD#QuobyteHD',id=3f09f86d-c25d-455a-a829-b1b5db6d3078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ea4dfff4ae04b518b1a10d1c4f5ef89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:46Z,use_quota=True,user_id='26dd01433c0848ba84bcab2e19ae3fa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88dbc1df-b1d0-49d4-b722-35dd6ef0aae6),volume_type_id=88dbc1df-b1d0-49d4-b722-35dd6ef0aae6)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Creating volume 3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:46 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:46 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 1073741824 Jun 26 22:06:46 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Created reservations ['fa31b461-717c-4244-88e3-665901f2b309', '372493f2-4a70-4665-be67-05003b179537', 'a4ff8fbc-4b30-4d91-a23a-d0f896dccf0d', 'cde4b446-db08-4720-a3e5-057e7ab44eff'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:46 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:46 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:46 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:06:46 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] GroupSnapshot e94ae512-d938-42a1-bf9e-825095f2f969: creating. Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Group snapshot e94ae512-d938-42a1-bf9e-825095f2f969: creating. {{(pid=93616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 26 22:06:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:47 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.815s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:47 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.704s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:06:47 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Deleted volume successfully. Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-259699d0-a7d1-4e78-9a25-d5bbe6e4409a tempest-VolumesCloneNegativeTest-191777823 None] Lock "cinder-6e23a118-a488-4247-8d8c-03fa42dc71f3-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:06:47 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 1073741824" returned: 0 in 0.985s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:47 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 Jun 26 22:06:47 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:47 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078" returned: 0 in 0.671s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.700s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.399s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c04ad28f-1b7c-4a55-910e-a3f1916b9e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f09f86d-c25d-455a-a829-b1b5db6d3078', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7942a999-cfe1-4156-9fc4-295d7bf8fd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Creating offline snapshot 5499c731-998e-42de-b400-ccd10f16f46e of volume 63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:06:48 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Volume volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 (3f09f86d-c25d-455a-a829-b1b5db6d3078): created successfully Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7942a999-cfe1-4156-9fc4-295d7bf8fd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Flow 'volume_create_manager' (baf8b47f-1f5b-4fc1-8769-d1782286508e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[44966bac-fa55-4709-8ba1-0d1efb9504db]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8c6770af-e8c3-4c51-8313-4803164b44f7 tempest-GroupSnapshotsV319Test-1466381588 None] Created volume successfully. Jun 26 22:06:48 devstack sudo[102225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 Jun 26 22:06:48 devstack sudo[102225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] GroupSnapshot 8bb9d40d-410b-4409-a255-9e6b9b361faa: creating. Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Group snapshot 8bb9d40d-410b-4409-a255-9e6b9b361faa: creating. {{(pid=93616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:48 devstack sudo[102225]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2" returned: 0 in 0.844s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:48 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e 1G Jun 26 22:06:48 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:49 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e 1G" returned: 0 in 0.876s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63822ea5-1135-43ba-90c1-6af36ff805c2 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:49 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63822ea5-1135-43ba-90c1-6af36ff805c2 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e Jun 26 22:06:49 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:50 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63822ea5-1135-43ba-90c1-6af36ff805c2 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e" returned: 0 in 0.873s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:50 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:50 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e Jun 26 22:06:50 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Flow 'volume_create_manager' (146ac779-08f8-42a0-b0c3-df0168882de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4597fc-10a3-47f4-ad8e-7ad5cbde1f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4597fc-10a3-47f4-ad8e-7ad5cbde1f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-466382494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0afc446-6130-4ae8-9c9d-2e4da4d7a77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390eaf2743df435b99331a256226ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:51Z,use_quota=True,user_id='d2faad773fdf4ad4b96c4fa06bc7ee38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebea1f3f-c4d7-4203-9433-d2e593fd65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebea1f3f-c4d7-4203-9433-d2e593fd65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b63c23-910d-4dd6-b4b9-d7c47f6c3972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b63c23-910d-4dd6-b4b9-d7c47f6c3972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e0afc446-6130-4ae8-9c9d-2e4da4d7a77e', 'volume_name': 'volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3ef3f4-7f35-46cf-bfa3-a81efdb0be9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f3ef3f4-7f35-46cf-bfa3-a81efdb0be9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9c8e37-e73f-4489-abe7-38fa55195be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:06:50 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Volume e0afc446-6130-4ae8-9c9d-2e4da4d7a77e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 26 22:06:50 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Trying to clone e0afc446-6130-4ae8-9c9d-2e4da4d7a77e from image 57efc2e5-cc7c-4583-b444-d036b0944149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:06:51 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e" returned: 0 in 0.676s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:51 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=94,cinder:UPDATE=103,cinder:INSERT=31,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:06:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:51 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:06:51 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Image download 20.69 MB at 20.69 MB/s Jun 26 22:06:51 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.info Jun 26 22:06:51 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:51 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea60950d-763f-4b71-9142-7b784f374618]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:51 devstack sudo[102248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD Jun 26 22:06:51 devstack sudo[102248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:52 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.info" returned: 0 in 0.688s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:52 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.info is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:52 devstack sudo[102251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.info Jun 26 22:06:52 devstack sudo[102251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:52 devstack sudo[102248]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 is fetched for user d2faad773fdf4ad4b96c4fa06bc7ee38. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3eba29-be08-4855-8c72-15df572daef2]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:52 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD Jun 26 22:06:52 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:52 devstack sudo[102251]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.info" returned: 0 in 0.665s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.777s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.879s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Creating offline snapshot 1a0ef7b4-db2f-46c9-9378-6a1556a60b9c of volume 3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[66599be0-21c1-45f7-a521-e2cc0fc3e3b6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d6f8f3a5-d706-44fe-9ba5-a100dc5e9a50 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot e94ae512-d938-42a1-bf9e-825095f2f969: created successfully Jun 26 22:06:53 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 Jun 26 22:06:53 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:53 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD" returned: 0 in 0.778s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:53 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078" returned: 0 in 0.833s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:53 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c 1G Jun 26 22:06:53 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:54 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c 1G" returned: 0 in 0.800s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:54 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c Jun 26 22:06:54 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:55 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" returned: 0 in 0.688s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:55 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:06:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:55 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c Jun 26 22:06:55 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:55 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" returned: 0 in 0.628s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:55 devstack sudo[102287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.info Jun 26 22:06:55 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:56 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.info" returned: 0 in 0.635s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:56 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.info is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:06:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:56 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.info Jun 26 22:06:56 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:57 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.info" returned: 0 in 0.604s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.318s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.923s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:06:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-466382494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0afc446-6130-4ae8-9c9d-2e4da4d7a77e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390eaf2743df435b99331a256226ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:06:51Z,use_quota=True,user_id='d2faad773fdf4ad4b96c4fa06bc7ee38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Creating volume e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:57 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:57 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 1073741824 Jun 26 22:06:57 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5c601ba2-ab3a-4534-9898-bb506906f544 tempest-GroupSnapshotsV319Test-1466381588 None] group_snapshot 8bb9d40d-410b-4409-a255-9e6b9b361faa: created successfully Jun 26 22:06:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] group_snapshot 8bb9d40d-410b-4409-a255-9e6b9b361faa: deleting Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] group_snapshot 8bb9d40d-410b-4409-a255-9e6b9b361faa: deleting {{(pid=93616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Acquiring lock "cinder-quobyte-3f09f86d-c25d-455a-a829-b1b5db6d3078" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Lock "cinder-quobyte-3f09f86d-c25d-455a-a829-b1b5db6d3078" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Acquiring lock "cinder-quobyte-1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Lock "cinder-quobyte-1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Deleting offline snapshot 1a0ef7b4-db2f-46c9-9378-6a1556a60b9c of volume 3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] snapshot_file for this snap is: volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4649a07-bb4d-4096-ac2b-ae12c90e4486]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:58 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c Jun 26 22:06:58 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:58 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 1073741824" returned: 0 in 1.061s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:58 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:06:58 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:59 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" returned: 0 in 1.148s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3f09f86d-c25d-455a-a829-b1b5db6d3078(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f84183-8ac7-4290-b61e-864147f3b048]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:59 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 0 in 0.969s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] <== create_volume: return (2077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.056s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-5499c731-998e-42de-b400-ccd10f16f46e-983ca181-6ed1-47c4-b980-32c95b032ba0" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-5499c731-998e-42de-b400-ccd10f16f46e-983ca181-6ed1-47c4-b980-32c95b032ba0" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Creating volume 983ca181-6ed1-47c4-b980-32c95b032ba0 from snapshot 5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-983ca181-6ed1-47c4-b980-32c95b032ba0" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Attempting download of 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume e0afc446-6130-4ae8-9c9d-2e4da4d7a77e. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-983ca181-6ed1-47c4-b980-32c95b032ba0" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] snapshot: 5499c731-998e-42de-b400-ccd10f16f46e, volume: 983ca181-6ed1-47c4-b980-32c95b032ba0, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:06:59 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 Jun 26 22:06:59 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e2a5b7-cdd8-4fda-b8cb-2d9ad2380e36]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe4088-e096-488c-a180-a56d9009ec29]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:06:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_pj9v6dfa {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:06:59 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_pj9v6dfa Jun 26 22:06:59 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:06:59 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e Jun 26 22:06:59 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:00 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078" returned: 0 in 1.422s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:00 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c Jun 26 22:07:00 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:00 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_pj9v6dfa" returned: 0 in 1.383s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_pj9v6dfa {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:00 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e" returned: 0 in 1.446s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63822ea5-1135-43ba-90c1-6af36ff805c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f39106-0a2f-4818-aa01-f94dcac10c1b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:00 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_pj9v6dfa Jun 26 22:07:00 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:00 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 Jun 26 22:07:00 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:01 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" returned: 0 in 0.930s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:01 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c Jun 26 22:07:01 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:01 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_pj9v6dfa" returned: 1 in 0.795s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_pj9v6dfa' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ffcea-8202-43aa-b180-9c219ffc0b16]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:01 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:07:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:01 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 Jun 26 22:07:01 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:01 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD Jun 26 22:07:01 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:02 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078.1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" returned: 0 in 0.726s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Lock "cinder-quobyte-1a0ef7b4-db2f-46c9-9378-6a1556a60b9c" released by "_delete_snapshot" :: held 4.352s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Lock "cinder-quobyte-3f09f86d-c25d-455a-a829-b1b5db6d3078" released by "delete_snapshot" :: held 4.383s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:02 devstack cinder-volume[93616]: WARNING cinder.quota [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1078347770 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1078347770, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:07:02 devstack cinder-volume[93616]: WARNING cinder.quota [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1078347770 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1078347770, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:07:02 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] Created reservations ['19626a3c-e439-4ab5-a801-322813c5c0de', 'ab7674e2-2201-4d56-8202-c6529571b153', '391d5fc9-2da7-4bc2-8037-adce41b1bbf4', '2d853375-cb85-4595-91f0-5c0de6f13986'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:02 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD" returned: 0 in 0.786s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:02 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] 57efc2e5-cc7c-4583-b444-d036b0944149 was qcow2, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:07:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:02 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:02 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:02 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8875f21c-fc50-46ea-a201-9a44989f01dd tempest-GroupSnapshotsV319Test-1466381588 None] group_snapshot 8bb9d40d-410b-4409-a255-9e6b9b361faa: deleted successfully Jun 26 22:07:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Acquiring lock "cinder-quobyte-3f09f86d-c25d-455a-a829-b1b5db6d3078" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Lock "cinder-quobyte-3f09f86d-c25d-455a-a829-b1b5db6d3078" acquired by "delete_volume" :: waited 0.042s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:04 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ee3902-2ae2-4add-a0ab-587f64bd166e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:04 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 Jun 26 22:07:04 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:06 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078" returned: 0 in 1.830s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:06 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078 Jun 26 22:07:06 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:07 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 0 in 4.712s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:07 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_czg3eukjdevstack@QuobyteHD, size 112.00 MB, duration 4.72 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:07:07 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Converted 112.00 MB image at 23.75 MB/s Jun 26 22:07:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:07 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 1G Jun 26 22:07:07 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:07 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f09f86d-c25d-455a-a829-b1b5db6d3078" returned: 0 in 1.146s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Lock "cinder-quobyte-3f09f86d-c25d-455a-a829-b1b5db6d3078" released by "delete_volume" :: held 3.156s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:07 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Created reservations ['3d394c14-8f78-4d02-9181-7c9ce9fda939'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:07 devstack cinder-volume[93616]: WARNING cinder.quota [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1078347770 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1078347770, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:07:07 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Created reservations ['37e8d023-b9dc-4fae-ab2d-0a4b03d4d5da', 'd56018ac-2670-4133-b734-55cd9f604834', 'ea095f3b-701c-4531-a396-108673923e59', 'c1b04c74-b3c0-4e6d-a002-999814e78f63'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:08 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:07:08 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:08 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0" returned: 0 in 6.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0307914a-d81c-435d-9d2d-791855fa5aad]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:08 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 Jun 26 22:07:08 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 1G" returned: 0 in 1.877s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:08 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d060e9b-d4ae-43cb-bbf9-12a6c84cfe85]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:09 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:09 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:09 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.520s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:09 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:07:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7fd8f1b4-32ad-4126-8eff-a7c313debbdb tempest-GroupSnapshotsV319Test-1466381588 None] Delete group completed successfully. Jun 26 22:07:09 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2" returned: 0 in 1.405s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:09 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2, size 1024.00 MB, duration 6.69 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:07:09 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Converted 1024.00 MB image at 152.95 MB/s Jun 26 22:07:09 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:07:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:09 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 Jun 26 22:07:09 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:10 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 0 in 1.400s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:10 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:10 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:11 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0" returned: 0 in 1.382s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-983ca181-6ed1-47c4-b980-32c95b032ba0" released by "_copy_volume_from_snapshot" :: held 11.901s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-5499c731-998e-42de-b400-ccd10f16f46e-983ca181-6ed1-47c4-b980-32c95b032ba0" released by "_create_volume_from_snapshot" :: held 11.973s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-24149d3a-992f-4b09-9576-778481371a2f tempest-GroupSnapshotsTest-1698552620 None] Create group from source-snapshot-e94ae512-d938-42a1-bf9e-825095f2f969 completed successfully. Jun 26 22:07:11 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 1 in 1.279s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Downloaded image 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume e0afc446-6130-4ae8-9c9d-2e4da4d7a77e successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 for user d2faad773fdf4ad4b96c4fa06bc7ee38 is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Marking volume e0afc446-6130-4ae8-9c9d-2e4da4d7a77e as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Copying metadata from image 57efc2e5-cc7c-4583-b444-d036b0944149 to e0afc446-6130-4ae8-9c9d-2e4da4d7a77e. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:07:11 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Creating volume glance metadata for volume e0afc446-6130-4ae8-9c9d-2e4da4d7a77e backed by image 57efc2e5-cc7c-4583-b444-d036b0944149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9c8e37-e73f-4489-abe7-38fa55195be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b8c44c-3018-4029-970c-3ac20e34fb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Volume volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e (e0afc446-6130-4ae8-9c9d-2e4da4d7a77e): created successfully Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34b8c44c-3018-4029-970c-3ac20e34fb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Flow 'volume_create_manager' (146ac779-08f8-42a0-b0c3-df0168882de0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6a7e0604-b5b7-479e-a3a1-c09b6f925195 tempest-VolumesExtendTest-651093009 None] Created volume successfully. Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-983ca181-6ed1-47c4-b980-32c95b032ba0" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-983ca181-6ed1-47c4-b980-32c95b032ba0" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[60236a3a-c36b-45bb-8691-da2ed2b793e3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:13 devstack sudo[102568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 Jun 26 22:07:13 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:13 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc8b809-83d0-45dd-a243-2f3576f79ced]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:13 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:13 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:14 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0" returned: 0 in 1.257s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:14 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0 Jun 26 22:07:14 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:14 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 0 in 1.516s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:14 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:14 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:15 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-983ca181-6ed1-47c4-b980-32c95b032ba0" returned: 0 in 0.893s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-983ca181-6ed1-47c4-b980-32c95b032ba0" released by "delete_volume" :: held 2.245s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['246d493a-1e64-44c1-b50c-b24c60bf135b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:15 devstack cinder-volume[93616]: WARNING cinder.quota [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-718583458 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-718583458, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:07:15 devstack cinder-volume[93616]: WARNING cinder.quota [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-718583458 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-718583458, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['b130a7c6-ee7a-4f8a-96db-866145ca414e', 'cdccd43d-b06d-4961-8cf2-855f2961c939', 'e81cc73c-8cfd-4942-bf0f-654bbba88b4c', 'ce6a6a8d-3055-4932-a9f1-44844f9d416f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:15 devstack sudo[102585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:07:15 devstack sudo[102585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot e94ae512-d938-42a1-bf9e-825095f2f969: deleting Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot e94ae512-d938-42a1-bf9e-825095f2f969: deleting {{(pid=93616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-63822ea5-1135-43ba-90c1-6af36ff805c2" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-63822ea5-1135-43ba-90c1-6af36ff805c2" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-5499c731-998e-42de-b400-ccd10f16f46e" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-5499c731-998e-42de-b400-ccd10f16f46e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Deleting offline snapshot 5499c731-998e-42de-b400-ccd10f16f46e of volume 63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] snapshot_file for this snap is: volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e292b31b-66de-438d-ab82-fce07809cf53]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:16 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e Jun 26 22:07:16 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:16 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 1 in 1.699s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 2G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e 2G" returned: 0 in 0.107s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 3.419s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:16 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-734670d0-d369-44e9-bcf6-ca9ebecfec1e tempest-VolumesExtendTest-651093009 None] Extend volume completed successfully. Jun 26 22:07:16 devstack sudo[102585]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.389s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:16 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:07:16 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-610340aa-41f4-43e3-b35b-4355a0909041 tempest-GroupSnapshotsTest-1698552620 None] Delete group completed successfully. Jun 26 22:07:17 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e" returned: 0 in 1.165s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63822ea5-1135-43ba-90c1-6af36ff805c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:17 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc892265-b50f-4a48-ba3c-ab84de50f68c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:17 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 Jun 26 22:07:17 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Flow 'volume_create_manager' (38e83a16-c752-423c-8543-5edd3d1b0be2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7ff30b-0c9f-4b6f-a6bb-fe585f1f99ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7ff30b-0c9f-4b6f-a6bb-fe585f1f99ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-147500875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198f5f42-c66c-4f51-ae2a-93fb92c53650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e4f3094b2b4d36bef31cfbd4e2d521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:18Z,use_quota=True,user_id='1c183cc1cc1945908dffee0a5290e9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddc7d63-4937-4098-9c20-5b6581913e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ddc7d63-4937-4098-9c20-5b6581913e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d544a354-5fc4-4e7f-9cdf-5e36b7e8120d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d544a354-5fc4-4e7f-9cdf-5e36b7e8120d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '198f5f42-c66c-4f51-ae2a-93fb92c53650', 'volume_name': 'volume-198f5f42-c66c-4f51-ae2a-93fb92c53650', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3838f09c-7fe3-4249-a3f2-d079fef4adce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3838f09c-7fe3-4249-a3f2-d079fef4adce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99985113-0163-4e2c-a03f-03e9f66acb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:18 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Volume 198f5f42-c66c-4f51-ae2a-93fb92c53650: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-198f5f42-c66c-4f51-ae2a-93fb92c53650', 'volume_size': 1} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-147500875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=198f5f42-c66c-4f51-ae2a-93fb92c53650,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e4f3094b2b4d36bef31cfbd4e2d521',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:18Z,use_quota=True,user_id='1c183cc1cc1945908dffee0a5290e9b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Creating volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:07:18 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:18 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Acquiring lock "cinder-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2" returned: 0 in 0.909s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:18 devstack sudo[102604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 1073741824 Jun 26 22:07:18 devstack sudo[102604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Lock "cinder-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:18 devstack sudo[102605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e Jun 26 22:07:18 devstack sudo[102605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Acquiring lock "cinder-quobyte-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7db834-56b0-448b-901f-10ab9319a76b]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:18 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:18 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:19 devstack sudo[102605]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e" returned: 0 in 0.986s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:19 devstack sudo[102604]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 1073741824" returned: 0 in 1.025s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:19 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e Jun 26 22:07:19 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:19 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 Jun 26 22:07:19 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:19 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 0 in 0.949s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:19 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:19 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:19 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2.5499c731-998e-42de-b400-ccd10f16f46e" returned: 0 in 0.767s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-5499c731-998e-42de-b400-ccd10f16f46e" released by "_delete_snapshot" :: held 3.956s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-63822ea5-1135-43ba-90c1-6af36ff805c2" released by "delete_snapshot" :: held 3.994s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:20 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650" returned: 0 in 0.812s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99985113-0163-4e2c-a03f-03e9f66acb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-198f5f42-c66c-4f51-ae2a-93fb92c53650', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b3e448-d923-4c70-bb12-25822ec9d9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:20 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Volume volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 (198f5f42-c66c-4f51-ae2a-93fb92c53650): created successfully Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07b3e448-d923-4c70-bb12-25822ec9d9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Flow 'volume_create_manager' (38e83a16-c752-423c-8543-5edd3d1b0be2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:20 devstack cinder-volume[93616]: WARNING cinder.quota [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-718583458 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-718583458, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:07:20 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-2ef2faa9-afe6-4896-b514-ca1b78bb6e35 tempest-SnapshotsActionsTest-244014671 None] Created volume successfully. Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['b07d2bb2-5192-46cf-ac70-c15adb0827e4', 'a08db961-ccf5-4d19-abca-ac42481b766f', '95298a60-8740-465f-bfd9-1a0378714f01', '61cbae2f-c94b-4514-9a16-888fbf88655b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:20 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 1 in 0.918s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:20 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f7df07ce-d45d-4a37-a3b3-e17b3049d2c0 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot e94ae512-d938-42a1-bf9e-825095f2f969: deleted successfully Jun 26 22:07:20 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e Jun 26 22:07:20 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:20 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" returned: 0 in 0.660s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e" released by "delete_volume" :: held 2.638s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:20 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Created reservations ['3612c883-ecae-4a06-8456-acbdfa0e35d0', 'f31b62a7-df16-4acc-9ca5-9c0f1a31b1c9', 'decb9f0a-a30d-463b-a8a7-efaf339424b9', 'f5d543b9-e4cc-4915-a6ca-3d1d4596b2c0'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-63822ea5-1135-43ba-90c1-6af36ff805c2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-63822ea5-1135-43ba-90c1-6af36ff805c2" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c51e76-2483-4ee0-958c-afc99f9ab196]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:21 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:07:21 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:21 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 Jun 26 22:07:21 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Creating offline snapshot e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a804c7-cb8e-4e65-aec6-888cdc3045d6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:21 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 Jun 26 22:07:21 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Flow 'volume_create_manager' (1eda59ee-87ff-48b0-b531-763f0f1ef711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfafbab3-db3b-461c-9180-062adcde4a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfafbab3-db3b-461c-9180-062adcde4a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1460784616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657651c2-ad3a-44b7-925f-a8cd76540aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390eaf2743df435b99331a256226ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:22Z,use_quota=True,user_id='d2faad773fdf4ad4b96c4fa06bc7ee38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18661eda-b89b-4ab8-a2fd-e0eff26eb09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18661eda-b89b-4ab8-a2fd-e0eff26eb09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fb0e75-c7a3-4100-8bc1-84a210baef50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47fb0e75-c7a3-4100-8bc1-84a210baef50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '657651c2-ad3a-44b7-925f-a8cd76540aef', 'volume_name': 'volume-657651c2-ad3a-44b7-925f-a8cd76540aef', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b32caf-2266-4368-b064-5dfa0058216b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b32caf-2266-4368-b064-5dfa0058216b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56888728-72cc-44b3-a0b4-c3c64c9153df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:22 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Volume 657651c2-ad3a-44b7-925f-a8cd76540aef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-657651c2-ad3a-44b7-925f-a8cd76540aef', 'volume_size': 1} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:22 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.086s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:07:22 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Deleted volume successfully. Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-87171397-37d3-4b34-92b8-982f7997ce7e tempest-VolumesExtendTest-651093009 None] Lock "cinder-e0afc446-6130-4ae8-9c9d-2e4da4d7a77e-delete_volume" released by "delete_volume" :: held 4.154s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:22 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2" returned: 0 in 1.265s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:22 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2 Jun 26 22:07:22 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:22 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650" returned: 0 in 1.326s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:22 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 1G Jun 26 22:07:22 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:23 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-63822ea5-1135-43ba-90c1-6af36ff805c2" returned: 0 in 0.713s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-63822ea5-1135-43ba-90c1-6af36ff805c2" released by "delete_volume" :: held 2.081s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['7b192321-cdcf-4bef-9ac6-5bef6e014a98'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:23 devstack cinder-volume[93616]: WARNING cinder.db.api [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-718583458'] Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['1022adaa-ba43-4b82-81b6-601ae1d6cef5', '2d7e16d2-24e1-4cda-be8c-bfd386923923', '3614cac6-a9f9-402c-9960-2ca553d96ed2', '362b58e6-b961-4426-bb1c-947a99ec9112'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:23 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:07:23 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:23 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 1G" returned: 0 in 0.923s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:23 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:07:23 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-86a71207-7dda-4a31-9492-a99eca92bf54 tempest-GroupSnapshotsTest-1698552620 None] Group tempest-GroupSnapshotsTest-Group-2048479739: creating Jun 26 22:07:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-86a71207-7dda-4a31-9492-a99eca92bf54 tempest-GroupSnapshotsTest-1698552620 None] Group tempest-GroupSnapshotsTest-Group-2048479739: created successfully Jun 26 22:07:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-86a71207-7dda-4a31-9492-a99eca92bf54 tempest-GroupSnapshotsTest-1698552620 None] Create group completed successfully. Jun 26 22:07:24 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.737s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:24 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:07:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-182ae1fe-882f-4da7-93a6-189c7f1c0878 tempest-GroupSnapshotsTest-1698552620 None] Delete group completed successfully. Jun 26 22:07:24 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.799s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:24 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 is being set with open permissions: ugo+rw Jun 26 22:07:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:24 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:07:24 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:25 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:25 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.info Jun 26 22:07:25 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (eb27c5a4-da5d-415b-a188-0a7d132e4dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005471de-eeb8-4717-a923-3f93938d88e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (005471de-eeb8-4717-a923-3f93938d88e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520673901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8481f050-dd37-4bd3-81d2-ce469a415e60,host='devstack@QuobyteHD#QuobyteHD',id=fcef5239-48df-48cb-b497-deab67123ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:26Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69164912-6713-4f43-9176-4b54a83fb749),volume_type_id=69164912-6713-4f43-9176-4b54a83fb749)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd87bd5-9074-49bb-abfe-a935ba8cb890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cd87bd5-9074-49bb-abfe-a935ba8cb890) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e38b98-2e38-420b-bc36-7b3ffecbea57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e38b98-2e38-420b-bc36-7b3ffecbea57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fcef5239-48df-48cb-b497-deab67123ec7', 'volume_name': 'volume-fcef5239-48df-48cb-b497-deab67123ec7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0633d6-5f56-4d1b-8195-04259c47b907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0633d6-5f56-4d1b-8195-04259c47b907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729cd9ef-bb56-4ccb-8a52-96509d187731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:25 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Volume fcef5239-48df-48cb-b497-deab67123ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fcef5239-48df-48cb-b497-deab67123ec7', 'volume_size': 1} Jun 26 22:07:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:26 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.info" returned: 0 in 0.763s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:26 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.info is being set with open permissions: ugo+rw Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:26 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.info Jun 26 22:07:26 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:26 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.info" returned: 0 in 0.706s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.334s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.556s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:07:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1460784616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=657651c2-ad3a-44b7-925f-a8cd76540aef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390eaf2743df435b99331a256226ac31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:22Z,use_quota=True,user_id='d2faad773fdf4ad4b96c4fa06bc7ee38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Creating volume 657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:07:26 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:07:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:26 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef 1073741824 Jun 26 22:07:26 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:26 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-2bb1afa2-7ae6-4893-87ed-503877c53ac1 tempest-SnapshotsActionsTest-244014671 None] Create snapshot completed successfully Jun 26 22:07:27 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef 1073741824" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:27 devstack sudo[102698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef Jun 26 22:07:27 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:28 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef" returned: 0 in 0.686s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.617s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8481f050-dd37-4bd3-81d2-ce469a415e60,created_at=2026-06-26T20:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1520673901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8481f050-dd37-4bd3-81d2-ce469a415e60,host='devstack@QuobyteHD#QuobyteHD',id=fcef5239-48df-48cb-b497-deab67123ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:26Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69164912-6713-4f43-9176-4b54a83fb749),volume_type_id=69164912-6713-4f43-9176-4b54a83fb749)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Creating volume fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:07:28 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56888728-72cc-44b3-a0b4-c3c64c9153df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-657651c2-ad3a-44b7-925f-a8cd76540aef', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cedf304-8a16-4eda-9709-f6602cde271f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:28 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 1073741824 Jun 26 22:07:28 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:28 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Volume volume-657651c2-ad3a-44b7-925f-a8cd76540aef (657651c2-ad3a-44b7-925f-a8cd76540aef): created successfully Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cedf304-8a16-4eda-9709-f6602cde271f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:28 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Flow 'volume_create_manager' (1eda59ee-87ff-48b0-b531-763f0f1ef711) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:28 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-13d1fb20-8eee-4a36-869f-0578dc3623b3 tempest-VolumesExtendTest-651093009 None] Created volume successfully. Jun 26 22:07:29 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 1073741824" returned: 0 in 0.823s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:29 devstack sudo[102707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 Jun 26 22:07:29 devstack sudo[102707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:29 devstack sudo[102707]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7" returned: 0 in 0.673s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.698s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Creating offline snapshot 2fdcb082-187a-49ad-a034-8fc9813e2177 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729cd9ef-bb56-4ccb-8a52-96509d187731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fcef5239-48df-48cb-b497-deab67123ec7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4537d630-43f8-45f6-a95a-63d9cfe038e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fcebaf-ff97-4a7f-8990-3b931ad16b82]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:30 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Volume volume-fcef5239-48df-48cb-b497-deab67123ec7 (fcef5239-48df-48cb-b497-deab67123ec7): created successfully Jun 26 22:07:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4537d630-43f8-45f6-a95a-63d9cfe038e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (eb27c5a4-da5d-415b-a188-0a7d132e4dfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:30 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3234d1b1-af6d-4db3-81a4-569572cbfdaf tempest-GroupSnapshotsTest-1698552620 None] Created volume successfully. Jun 26 22:07:30 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:07:30 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:30 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.809s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:30 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 1G Jun 26 22:07:30 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (02dc8305-f8fe-418a-bf26-7fcc3fe1d5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f7dce1-8441-497b-b1db-abef5f572044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f7dce1-8441-497b-b1db-abef5f572044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119502517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8481f050-dd37-4bd3-81d2-ce469a415e60,host='devstack@QuobyteHD#QuobyteHD',id=f44e192a-61e7-4ef0-ace3-1626b07ead23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:31Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69164912-6713-4f43-9176-4b54a83fb749),volume_type_id=69164912-6713-4f43-9176-4b54a83fb749)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a053bd57-4472-4eb4-b06b-21253e8a295b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a053bd57-4472-4eb4-b06b-21253e8a295b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01deb211-f9a7-4dae-a56c-35c5104a6366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01deb211-f9a7-4dae-a56c-35c5104a6366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f44e192a-61e7-4ef0-ace3-1626b07ead23', 'volume_name': 'volume-f44e192a-61e7-4ef0-ace3-1626b07ead23', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c42802-4e11-4629-9b04-93591801a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c42802-4e11-4629-9b04-93591801a58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49bf4dc-d7e0-4641-94fd-1d0cb879f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:31 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Volume f44e192a-61e7-4ef0-ace3-1626b07ead23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f44e192a-61e7-4ef0-ace3-1626b07ead23', 'volume_size': 1} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:31 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 1G" returned: 0 in 0.921s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:31 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 Jun 26 22:07:31 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:32 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177" returned: 0 in 0.680s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:32 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 is being set with open permissions: ugo+rw Jun 26 22:07:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:32 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 Jun 26 22:07:32 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:33 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177" returned: 0 in 0.608s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.142s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.209s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Creating offline snapshot 4eb5dba5-02db-4b81-af0c-1fca5da36fb5 of volume 657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:07:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-436c4f18-4608-445e-9f0d-53d85bdabf8c tempest-SnapshotsActionsTest-244014671 None] Create snapshot completed successfully Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[16602bf5-0a03-48fb-a334-23029f370d9e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:33 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef Jun 26 22:07:33 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-2fdcb082-187a-49ad-a034-8fc9813e2177-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-2fdcb082-187a-49ad-a034-8fc9813e2177-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-2fdcb082-187a-49ad-a034-8fc9813e2177" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-2fdcb082-187a-49ad-a034-8fc9813e2177" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Deleting offline snapshot 2fdcb082-187a-49ad-a034-8fc9813e2177 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] snapshot_file for this snap is: volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd741b-e00d-4ccd-8d2d-9ffc0a18135a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:33 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 Jun 26 22:07:33 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:33 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef" returned: 0 in 0.755s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:33 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 1G Jun 26 22:07:33 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:34 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177" returned: 0 in 0.785s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:34 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0e97a-5b3e-488a-9936-0db76c6b2d87]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:34 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:07:34 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:34 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 1G" returned: 0 in 0.865s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657651c2-ad3a-44b7-925f-a8cd76540aef -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:34 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657651c2-ad3a-44b7-925f-a8cd76540aef -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 Jun 26 22:07:34 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:35 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.806s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:35 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 Jun 26 22:07:35 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:35 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-657651c2-ad3a-44b7-925f-a8cd76540aef -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5" returned: 0 in 0.690s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:35 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 is being set with open permissions: ugo+rw Jun 26 22:07:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:35 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 Jun 26 22:07:35 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:36 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5" returned: 0 in 0.986s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:36 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177" returned: 0 in 1.160s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:36 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177 Jun 26 22:07:36 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:36 devstack sudo[102822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.info Jun 26 22:07:36 devstack sudo[102822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:37 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.2fdcb082-187a-49ad-a034-8fc9813e2177" returned: 0 in 0.702s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:37 devstack sudo[102822]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.info" returned: 0 in 0.712s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:37 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.info is being set with open permissions: ugo+rw Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-2fdcb082-187a-49ad-a034-8fc9813e2177" released by "_delete_snapshot" :: held 3.582s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" released by "delete_snapshot" :: held 3.609s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:37 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.info Jun 26 22:07:37 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Created reservations ['f86d631d-b7b0-468e-a6bc-a64c5912a7b7', 'f86c1b8e-cc68-4bd7-9d2f-13c683785f6e', 'a1cfbcc0-b40a-4617-9d32-e344e39de7f7', 'aee755e6-139e-40aa-bc66-ca20bca8ce4c'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:37 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Delete snapshot completed successfully. Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9369ade6-f23a-431f-8465-7524e6a7072f tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-2fdcb082-187a-49ad-a034-8fc9813e2177-delete_snapshot" released by "delete_snapshot" :: held 3.801s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:37 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.info" returned: 0 in 0.823s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.993s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.802s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8481f050-dd37-4bd3-81d2-ce469a415e60,created_at=2026-06-26T20:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1119502517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8481f050-dd37-4bd3-81d2-ce469a415e60,host='devstack@QuobyteHD#QuobyteHD',id=f44e192a-61e7-4ef0-ace3-1626b07ead23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:07:31Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(69164912-6713-4f43-9176-4b54a83fb749),volume_type_id=69164912-6713-4f43-9176-4b54a83fb749)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Creating volume f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:07:38 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:38 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 1073741824 Jun 26 22:07:38 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9d23c519-379f-42d2-9148-963c2f215bf4 tempest-VolumesExtendTest-651093009 None] Create snapshot completed successfully Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:38 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 1073741824" returned: 0 in 0.900s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:39 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 Jun 26 22:07:39 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:39 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23" returned: 0 in 0.641s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] <== create_volume: return (1593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.446s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Creating offline snapshot 377b9bbe-39a3-4043-967b-e6dc0dd13f85 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49bf4dc-d7e0-4641-94fd-1d0cb879f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f44e192a-61e7-4ef0-ace3-1626b07ead23', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54977df8-f4b8-4e54-a2c0-688df3f5acaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95babe0-b3cb-4365-b88a-a37b982be6f2]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Volume volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 (f44e192a-61e7-4ef0-ace3-1626b07ead23): created successfully Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54977df8-f4b8-4e54-a2c0-688df3f5acaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:07:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (02dc8305-f8fe-418a-bf26-7fcc3fe1d5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:07:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b5ea6c56-c95d-492d-8f7f-aaeb73920e94 tempest-GroupSnapshotsTest-1698552620 None] Created volume successfully. Jun 26 22:07:39 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:07:39 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:40 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.779s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:40 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 1G Jun 26 22:07:40 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f239e015-19c8-44e5-b7d2-48c394d9915a tempest-GroupSnapshotsTest-1698552620 None] Update group completed successfully. Jun 26 22:07:41 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 1G" returned: 0 in 0.836s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:41 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 Jun 26 22:07:41 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:42 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85" returned: 0 in 0.718s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:42 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 is being set with open permissions: ugo+rw Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:42 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 Jun 26 22:07:42 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=119,cinder:INSERT=33,cinder:UPDATE=96,cinder:DELETE=6 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:07:42 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-31c2544e-fc79-4585-b290-4c48f3a3111c tempest-GroupSnapshotsTest-1698552620 None] Update group completed successfully. Jun 26 22:07:42 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85" returned: 0 in 0.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.133s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 3.431s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc2ae494-802f-4a40-937d-c525d449172a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:42 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-60f304e4-da35-489f-b69b-1845dc79b72e tempest-SnapshotsActionsTest-244014671 None] Create snapshot completed successfully Jun 26 22:07:42 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef Jun 26 22:07:42 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6e34d305-89a4-48e4-b955-013e9b0cf39b tempest-GroupSnapshotsTest-1698552620 None] Update group completed successfully. Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-377b9bbe-39a3-4043-967b-e6dc0dd13f85-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-377b9bbe-39a3-4043-967b-e6dc0dd13f85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-377b9bbe-39a3-4043-967b-e6dc0dd13f85" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-377b9bbe-39a3-4043-967b-e6dc0dd13f85" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Deleting offline snapshot 377b9bbe-39a3-4043-967b-e6dc0dd13f85 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:07:43 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] snapshot_file for this snap is: volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef" returned: 0 in 0.858s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 2G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b2087-00a7-4b2f-b243-0eba8f22c2f4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 2G" returned: 0 in 0.143s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.036s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:43 devstack sudo[102872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 Jun 26 22:07:43 devstack sudo[102872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3f71b398-2139-4835-81ac-9dad57d8bea8 tempest-VolumesExtendTest-651093009 None] Extend volume completed successfully. Jun 26 22:07:44 devstack sudo[102872]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85" returned: 0 in 0.837s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[267f8a15-1271-416d-a8b7-6d71318a963b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0b104ee7-525c-42e9-9b20-bd48bffa5770 tempest-GroupSnapshotsTest-1698552620 None] Update group completed successfully. Jun 26 22:07:44 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:07:44 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-400f58b5-6076-4fd0-8062-b86cb3d8481c req-3b8a0e26-0e1e-486b-9173-ab69f5d78aa8 tempest-AttachVolumeNegativeTest-1350716939 None] Terminate volume connection completed successfully. Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-400f58b5-6076-4fd0-8062-b86cb3d8481c req-3b8a0e26-0e1e-486b-9173-ab69f5d78aa8 tempest-AttachVolumeNegativeTest-1350716939 None] Deleting attachment 3a2a6666-f1f4-4ee8-8cf9-9f73558c8f94. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Acquiring lock "cinder-4eb5dba5-02db-4b81-af0c-1fca5da36fb5-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Lock "cinder-4eb5dba5-02db-4b81-af0c-1fca5da36fb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Acquiring lock "cinder-quobyte-657651c2-ad3a-44b7-925f-a8cd76540aef" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-657651c2-ad3a-44b7-925f-a8cd76540aef" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Acquiring lock "cinder-quobyte-4eb5dba5-02db-4b81-af0c-1fca5da36fb5" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-4eb5dba5-02db-4b81-af0c-1fca5da36fb5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Deleting offline snapshot 4eb5dba5-02db-4b81-af0c-1fca5da36fb5 of volume 657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] snapshot_file for this snap is: volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[175fbd47-53df-4632-86d9-aef7a6af7820]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:45 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 Jun 26 22:07:45 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:45 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.824s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:45 devstack sudo[102893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 Jun 26 22:07:45 devstack sudo[102893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:45 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5" returned: 0 in 0.791s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-657651c2-ad3a-44b7-925f-a8cd76540aef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[588b357b-98e0-4996-8d97-0bfe3865a918]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:45 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef Jun 26 22:07:45 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:46 devstack sudo[102893]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85" returned: 0 in 0.852s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:46 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85 Jun 26 22:07:46 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] GroupSnapshot d974cd45-b9bf-4497-b2b3-f7a2491340aa: creating. Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:46 devstack sudo[102906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:07:46 devstack sudo[102906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Group snapshot d974cd45-b9bf-4497-b2b3-f7a2491340aa: creating. {{(pid=93616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Creating offline snapshot 8a6546dd-6be4-499f-9427-229122d5882e of volume f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5697abf-8b08-47e2-bef2-062b3f71198f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:46 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 Jun 26 22:07:46 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:46 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef" returned: 0 in 0.914s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:46 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 Jun 26 22:07:46 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:47 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.377b9bbe-39a3-4043-967b-e6dc0dd13f85" returned: 0 in 0.913s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:47 devstack sudo[102906]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.857s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-377b9bbe-39a3-4043-967b-e6dc0dd13f85" released by "_delete_snapshot" :: held 3.567s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" released by "delete_snapshot" :: held 3.601s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Created reservations ['a725129c-e3c6-414a-aca7-ca3f87d49c13', 'f580972d-4c24-4622-8f7b-59a8cd0e2b5b', '75134f2e-cbec-4d6e-af1d-5a9b6ed63742', '82d0a7b3-aa49-496d-b861-3e66d17dbe2d'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:47 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Delete snapshot completed successfully. Jun 26 22:07:47 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-33e3ad80-d212-46eb-a91b-8346ce6ceb9b tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-377b9bbe-39a3-4043-967b-e6dc0dd13f85-delete_snapshot" released by "delete_snapshot" :: held 3.808s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23" returned: 0 in 0.960s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:47 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e 1G Jun 26 22:07:47 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:47 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5" returned: 0 in 0.956s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:47 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5 Jun 26 22:07:47 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:48 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e 1G" returned: 0 in 1.142s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:48 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef.4eb5dba5-02db-4b81-af0c-1fca5da36fb5" returned: 0 in 0.912s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:48 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e Jun 26 22:07:48 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-4eb5dba5-02db-4b81-af0c-1fca5da36fb5" released by "_delete_snapshot" :: held 3.697s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-657651c2-ad3a-44b7-925f-a8cd76540aef" released by "delete_snapshot" :: held 3.725s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Created reservations ['89fad9b7-8bd3-42a7-b4b4-67dff4aeeaf3', 'a7851203-f886-4c9c-9973-3e732d9a6a87', 'e55b1400-8656-4dcf-98b2-510a63dedfa9', 'a888d391-7351-49ac-965d-d13e39d26730'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Delete snapshot completed successfully. Jun 26 22:07:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-41726497-cec5-4932-8408-1a27b86eabc5 tempest-VolumesExtendTest-651093009 None] Lock "cinder-4eb5dba5-02db-4b81-af0c-1fca5da36fb5-delete_snapshot" released by "delete_snapshot" :: held 3.920s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Acquiring lock "cinder-657651c2-ad3a-44b7-925f-a8cd76540aef-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Lock "cinder-657651c2-ad3a-44b7-925f-a8cd76540aef-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Acquiring lock "cinder-quobyte-657651c2-ad3a-44b7-925f-a8cd76540aef" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-657651c2-ad3a-44b7-925f-a8cd76540aef" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26831d6-6662-4e05-ae51-bef984762b66]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:49 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e" returned: 0 in 0.814s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:49 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:07:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:49 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e Jun 26 22:07:49 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:49 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef Jun 26 22:07:49 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:50 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e" returned: 0 in 0.716s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:50 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef" returned: 0 in 0.798s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:50 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef Jun 26 22:07:50 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:50 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.info Jun 26 22:07:50 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:50 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-657651c2-ad3a-44b7-925f-a8cd76540aef" returned: 0 in 0.724s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Lock "cinder-quobyte-657651c2-ad3a-44b7-925f-a8cd76540aef" released by "delete_volume" :: held 1.585s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:50 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.info" returned: 0 in 0.743s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:50 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.info is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:50 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.info Jun 26 22:07:50 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Created reservations ['40d14c28-6cff-4cf4-9c95-38a3907161ea', 'eb77141b-7793-4869-885d-05e010b1659b', '9c780895-fb98-45cf-9c35-fa834ac94dd5', '028824cf-ef0a-458c-a7ce-7b3e7da77ea8'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:51 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:07:51 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:51 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.info" returned: 0 in 0.613s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.112s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Creating offline snapshot 9d5d58b1-37d9-49d5-afd8-c7e748228198 of volume fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[588c4390-2edd-429b-890f-9170dd8178b1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:51 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 Jun 26 22:07:51 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:51 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.723s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:07:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Deleted volume successfully. Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=120,cinder:INSERT=32,cinder:UPDATE=122,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:07:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f2413717-ae4e-48c9-b912-ed27be26ccc8 tempest-VolumesExtendTest-651093009 None] Lock "cinder-657651c2-ad3a-44b7-925f-a8cd76540aef-delete_volume" released by "delete_volume" :: held 2.541s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:07:52 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7" returned: 0 in 0.866s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:52 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 1G Jun 26 22:07:52 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:53 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 1G" returned: 0 in 0.853s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcef5239-48df-48cb-b497-deab67123ec7 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:53 devstack sudo[103020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcef5239-48df-48cb-b497-deab67123ec7 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 Jun 26 22:07:53 devstack sudo[103020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:54 devstack sudo[103020]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fcef5239-48df-48cb-b497-deab67123ec7 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198" returned: 0 in 0.704s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:54 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:07:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:54 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 Jun 26 22:07:54 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:54 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198" returned: 0 in 0.708s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:54 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.info Jun 26 22:07:54 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:55 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.info" returned: 0 in 0.732s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:55 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.info is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:07:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:55 devstack sudo[103032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.info Jun 26 22:07:55 devstack sudo[103032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:56 devstack sudo[103032]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.info" returned: 0 in 0.703s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.692s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:07:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.967s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:07:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Creating offline snapshot 3767deed-feb7-4c75-a3b5-10c2a302a87a of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:07:56 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcad8314-23a1-4620-9943-4e08a98b3754]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-92bd7c59-6b07-4561-ac67-b5ea150f8e2f tempest-GroupSnapshotsTest-1698552620 None] group_snapshot d974cd45-b9bf-4497-b2b3-f7a2491340aa: created successfully Jun 26 22:07:56 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:07:56 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot d974cd45-b9bf-4497-b2b3-f7a2491340aa: deleting Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot d974cd45-b9bf-4497-b2b3-f7a2491340aa: deleting {{(pid=93616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-f44e192a-61e7-4ef0-ace3-1626b07ead23" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-f44e192a-61e7-4ef0-ace3-1626b07ead23" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-8a6546dd-6be4-499f-9427-229122d5882e" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-8a6546dd-6be4-499f-9427-229122d5882e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Deleting offline snapshot 8a6546dd-6be4-499f-9427-229122d5882e of volume f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] snapshot_file for this snap is: volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0aa209-ad79-41ef-970e-b15293e9612d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:57 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.905s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:57 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a 1G Jun 26 22:07:57 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:57 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e Jun 26 22:07:57 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:58 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e" returned: 0 in 0.927s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f44e192a-61e7-4ef0-ace3-1626b07ead23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:07:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[22fdacc0-2e60-4e68-ab24-4859b6cd480b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:07:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:58 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 Jun 26 22:07:58 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:58 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a 1G" returned: 0 in 1.158s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:58 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a Jun 26 22:07:58 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:59 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23" returned: 0 in 0.917s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:59 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e Jun 26 22:07:59 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:59 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a" returned: 0 in 0.898s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:59 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a is being set with open permissions: ugo+rw Jun 26 22:07:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:59 devstack sudo[103067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a Jun 26 22:07:59 devstack sudo[103067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:07:59 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Jun 26 22:07:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e" returned: 0 in 0.885s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:07:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:07:59 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e Jun 26 22:07:59 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:00 devstack sudo[103067]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a" returned: 0 in 0.794s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.935s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:00 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bd2386c0-b5f4-4bda-9e32-e8e017fc25fd tempest-SnapshotsActionsTest-244014671 None] Create snapshot completed successfully Jun 26 22:08:00 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23.8a6546dd-6be4-499f-9427-229122d5882e" returned: 0 in 0.827s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-8a6546dd-6be4-499f-9427-229122d5882e" released by "_delete_snapshot" :: held 3.710s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-f44e192a-61e7-4ef0-ace3-1626b07ead23" released by "delete_snapshot" :: held 3.737s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-fcef5239-48df-48cb-b497-deab67123ec7" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-3767deed-feb7-4c75-a3b5-10c2a302a87a-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-fcef5239-48df-48cb-b497-deab67123ec7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-9d5d58b1-37d9-49d5-afd8-c7e748228198" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-3767deed-feb7-4c75-a3b5-10c2a302a87a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-9d5d58b1-37d9-49d5-afd8-c7e748228198" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Deleting offline snapshot 9d5d58b1-37d9-49d5-afd8-c7e748228198 of volume fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] snapshot_file for this snap is: volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" acquired by "delete_snapshot" :: waited 0.061s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-3767deed-feb7-4c75-a3b5-10c2a302a87a" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:01 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60f5139-c1fd-4f91-9bac-43e4b7567c2c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-3767deed-feb7-4c75-a3b5-10c2a302a87a" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Deleting offline snapshot 3767deed-feb7-4c75-a3b5-10c2a302a87a of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:08:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] snapshot_file for this snap is: volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:08:01 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44eb9c5-29be-40cb-8ed1-ca14b6bc09b4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:01 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 Jun 26 22:08:01 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:01 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a Jun 26 22:08:01 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:01 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198" returned: 0 in 0.991s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fcef5239-48df-48cb-b497-deab67123ec7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba86eee0-1e30-4cde-abed-c9542b61177a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:02 devstack sudo[103121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 Jun 26 22:08:02 devstack sudo[103121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:02 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a" returned: 0 in 1.387s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[892b02d1-65fc-485f-acc5-1f4a7e37c201]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:02 devstack sudo[103128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:08:02 devstack sudo[103128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:03 devstack sudo[103121]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7" returned: 0 in 0.985s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:03 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 Jun 26 22:08:03 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:03 devstack sudo[103128]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.964s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:03 devstack sudo[103139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a Jun 26 22:08:03 devstack sudo[103139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:04 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198" returned: 0 in 1.114s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:04 devstack sudo[103145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198 Jun 26 22:08:04 devstack sudo[103145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:04 devstack sudo[103139]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a" returned: 0 in 1.279s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:04 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a Jun 26 22:08:04 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:05 devstack sudo[103145]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7.9d5d58b1-37d9-49d5-afd8-c7e748228198" returned: 0 in 0.926s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-9d5d58b1-37d9-49d5-afd8-c7e748228198" released by "_delete_snapshot" :: held 4.214s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-fcef5239-48df-48cb-b497-deab67123ec7" released by "delete_snapshot" :: held 4.253s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:05 devstack cinder-volume[93616]: WARNING cinder.quota [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1241888008 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1241888008, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:08:05 devstack cinder-volume[93616]: WARNING cinder.quota [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1241888008 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1241888008, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['8cbf02d1-5451-494c-8830-47fb5ae1bd4b', '10cb0746-61c4-482f-860d-b23b8128ea72', '17b7df2f-e54b-4041-b394-d9aeb33232f0', '457f82d6-36ad-4109-a4bf-1d16b3bb0f07'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['9c9a1ac0-77de-4f50-ae74-bd577aabd5de', 'efa0f3b1-426e-492a-8ee5-f488ddd91265', '2d9ffdf5-1755-491f-b5cc-571d1dc1d36f', 'c887a847-3132-4c30-b24c-f39056faa4b0'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:05 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-29c44d1f-78b4-474b-8a33-70c893403a70 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot d974cd45-b9bf-4497-b2b3-f7a2491340aa: deleted successfully Jun 26 22:08:05 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.3767deed-feb7-4c75-a3b5-10c2a302a87a" returned: 0 in 0.932s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-3767deed-feb7-4c75-a3b5-10c2a302a87a" released by "_delete_snapshot" :: held 4.751s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" released by "delete_snapshot" :: held 4.813s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:05 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Created reservations ['56d667db-cc9d-40d9-9c38-abbbc458e383', '9a18c095-26b7-4bcd-b551-11851257f627', '8915ac53-40c4-4ae8-b622-91e830f606a2', '6ee2d800-c38d-4e3b-9ffb-65ac3c92ec12'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:06 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Delete snapshot completed successfully. Jun 26 22:08:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c59471e4-36b0-4392-904a-2d2edb44fbf9 tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-3767deed-feb7-4c75-a3b5-10c2a302a87a-delete_snapshot" released by "delete_snapshot" :: held 5.099s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-f44e192a-61e7-4ef0-ace3-1626b07ead23" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-f44e192a-61e7-4ef0-ace3-1626b07ead23" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:06 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57e7c1-0c75-41a2-bbc3-284904814d22]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:06 devstack sudo[103172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 Jun 26 22:08:06 devstack sudo[103172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:07 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Creating offline snapshot e0293ee1-7a6e-43d0-9313-627464ee99a1 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:08:07 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c94c96-fb41-4cc8-a76e-6da4a94b0413]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:07 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:08:07 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:07 devstack sudo[103172]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23" returned: 0 in 1.060s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:07 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23 Jun 26 22:08:07 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:08 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 1.036s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:08 devstack sudo[103185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 1G Jun 26 22:08:08 devstack sudo[103185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:08 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f44e192a-61e7-4ef0-ace3-1626b07ead23" returned: 0 in 0.959s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-f44e192a-61e7-4ef0-ace3-1626b07ead23" released by "delete_volume" :: held 2.120s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-fcef5239-48df-48cb-b497-deab67123ec7" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-fcef5239-48df-48cb-b497-deab67123ec7" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cba88ba-4ce2-48ae-a342-c98c16b0fd6c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:09 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 Jun 26 22:08:09 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:09 devstack sudo[103185]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 1G" returned: 0 in 1.307s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:09 devstack sudo[103196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 Jun 26 22:08:09 devstack sudo[103196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:09 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7" returned: 0 in 0.920s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:09 devstack sudo[103204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7 Jun 26 22:08:09 devstack sudo[103204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:10 devstack sudo[103196]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1" returned: 0 in 0.818s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:10 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 is being set with open permissions: ugo+rw Jun 26 22:08:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:10 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 Jun 26 22:08:10 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:10 devstack sudo[103204]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fcef5239-48df-48cb-b497-deab67123ec7" returned: 0 in 0.918s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-fcef5239-48df-48cb-b497-deab67123ec7" released by "delete_volume" :: held 1.903s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:10 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['99c45ed6-972a-4618-9c13-cef1474b1227'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:10 devstack cinder-volume[93616]: WARNING cinder.quota [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1241888008 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1241888008, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:08:10 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['526b7ae7-cb6f-4ff7-8737-335125bf3a46', '8c985273-156b-4d31-9770-385b56c157f8', 'f0405dad-d8c8-4fe4-9b6c-1e066e5ae347', '13a31ac5-c282-4257-8f50-7c121ba4115b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['ee3b9c14-0d88-4db7-b93a-c4d44e45761e', 'c1dcd34d-443b-4859-a60d-b54be0e9a146', '339ba1dd-ae5a-458e-8651-2f84c0fbd9d1', '5bf732b0-24f1-442d-a9f4-1ca81c19dceb'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:11 devstack sudo[103213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:08:11 devstack sudo[103213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:11 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1" returned: 0 in 0.943s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.290s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ba3e0156-50b3-40b4-98d3-4fa274acd419 tempest-SnapshotsActionsTest-244014671 None] Create snapshot completed successfully Jun 26 22:08:12 devstack sudo[103213]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.006s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:08:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-de3ef3bc-b0f1-4700-bc0f-4f9ac51efb11 tempest-GroupSnapshotsTest-1698552620 None] Delete group completed successfully. Jun 26 22:08:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-818b16c7-b151-4987-be7f-c509666b4355 tempest-GroupSnapshotsTest-1698552620 None] Group tempest-GroupSnapshotsTest-Group-1996145639: creating Jun 26 22:08:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-818b16c7-b151-4987-be7f-c509666b4355 tempest-GroupSnapshotsTest-1698552620 None] Group tempest-GroupSnapshotsTest-Group-1996145639: created successfully Jun 26 22:08:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-818b16c7-b151-4987-be7f-c509666b4355 tempest-GroupSnapshotsTest-1698552620 None] Create group completed successfully. Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-e0293ee1-7a6e-43d0-9313-627464ee99a1-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-e0293ee1-7a6e-43d0-9313-627464ee99a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Acquiring lock "cinder-quobyte-e0293ee1-7a6e-43d0-9313-627464ee99a1" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-e0293ee1-7a6e-43d0-9313-627464ee99a1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Deleting offline snapshot e0293ee1-7a6e-43d0-9313-627464ee99a1 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] snapshot_file for this snap is: volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[974c1288-7ecf-47b4-be19-a3959c42339a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:12 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 Jun 26 22:08:12 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:13 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1" returned: 0 in 1.053s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:13 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a319f09b-1ee8-4e7c-8bb4-e3570d57342b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:13 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:08:13 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (41bf5353-5033-41e2-a7e7-bab92a97c806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2982b832-08f6-445a-b1bb-a3224b84d2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2982b832-08f6-445a-b1bb-a3224b84d2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960565490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7a2fef0-469b-4060-befa-e0700f810e10,host='devstack@QuobyteHD#QuobyteHD',id=72a49341-4c52-4f98-9482-c4226ad9ec81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:08:14Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77e243e2-dcbb-4517-ae10-eb88372d6c7a),volume_type_id=77e243e2-dcbb-4517-ae10-eb88372d6c7a)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cca902e-a4da-44da-a174-59c81b08ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cca902e-a4da-44da-a174-59c81b08ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9135db5c-aa89-4e1d-afaa-882596d44daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9135db5c-aa89-4e1d-afaa-882596d44daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72a49341-4c52-4f98-9482-c4226ad9ec81', 'volume_name': 'volume-72a49341-4c52-4f98-9482-c4226ad9ec81', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03283930-eeaf-430b-ab04-c074c42d35bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03283930-eeaf-430b-ab04-c074c42d35bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9797069-bfe7-44dd-b8a6-09b14afd3d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:14 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Volume 72a49341-4c52-4f98-9482-c4226ad9ec81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72a49341-4c52-4f98-9482-c4226ad9ec81', 'volume_size': 1} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f7a2fef0-469b-4060-befa-e0700f810e10,created_at=2026-06-26T20:08:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-960565490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7a2fef0-469b-4060-befa-e0700f810e10,host='devstack@QuobyteHD#QuobyteHD',id=72a49341-4c52-4f98-9482-c4226ad9ec81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93435f5427f04d968442c2f346c4da2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:08:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:08:14Z,use_quota=True,user_id='533053534a22486d889f9f4bd658afc5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(77e243e2-dcbb-4517-ae10-eb88372d6c7a),volume_type_id=77e243e2-dcbb-4517-ae10-eb88372d6c7a)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Creating volume 72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:08:14 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:08:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:14 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 1073741824 Jun 26 22:08:14 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:15 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 1.870s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:15 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 Jun 26 22:08:15 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:16 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 1073741824" returned: 0 in 1.587s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:16 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 Jun 26 22:08:16 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:17 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1" returned: 0 in 1.747s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:17 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1 Jun 26 22:08:17 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:17 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81" returned: 0 in 1.544s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] <== create_volume: return (3219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.231s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9797069-bfe7-44dd-b8a6-09b14afd3d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72a49341-4c52-4f98-9482-c4226ad9ec81', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2646f2b-d577-42e8-a744-5b09ee996ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:17 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Volume volume-72a49341-4c52-4f98-9482-c4226ad9ec81 (72a49341-4c52-4f98-9482-c4226ad9ec81): created successfully Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2646f2b-d577-42e8-a744-5b09ee996ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Flow 'volume_create_manager' (41bf5353-5033-41e2-a7e7-bab92a97c806) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:08:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f77249d9-44fd-4666-a001-34900555f80d tempest-GroupSnapshotsTest-1698552620 None] Created volume successfully. Jun 26 22:08:18 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e0293ee1-7a6e-43d0-9313-627464ee99a1" returned: 0 in 1.370s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-e0293ee1-7a6e-43d0-9313-627464ee99a1" released by "_delete_snapshot" :: held 6.221s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" released by "delete_snapshot" :: held 6.256s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] GroupSnapshot 0ba7e7b3-5085-4252-b2b9-6433decab451: creating. Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Group snapshot 0ba7e7b3-5085-4252-b2b9-6433decab451: creating. {{(pid=93616) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Creating offline snapshot ded32b54-039e-40e8-83ce-fc0005daa2d3 of volume 72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7715af3-b4a0-47c6-99f7-3fce926478ef]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:18 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Created reservations ['b4c53a60-ce4e-4120-aa02-5a0269e86561', 'f773ed80-1cee-423e-818f-8736a7f63cbf', 'ad313ef5-4a0e-46c6-9ccf-e58b4ae07ba4', '36d65f23-0193-490e-bd37-d60c27c1089c'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Delete snapshot completed successfully. Jun 26 22:08:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aec8407c-7534-470e-8145-facc9efc0eec tempest-SnapshotsActionsTest-478719325 None] Lock "cinder-e0293ee1-7a6e-43d0-9313-627464ee99a1-delete_snapshot" released by "delete_snapshot" :: held 6.534s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:19 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 Jun 26 22:08:19 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:20 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81" returned: 0 in 1.206s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:20 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 1G Jun 26 22:08:20 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "cinder-e2354b4e-3080-4e8f-8b94-d4612ad2a0a9-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-e2354b4e-3080-4e8f-8b94-d4612ad2a0a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "cinder-quobyte-e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-quobyte-e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Deleting offline snapshot e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 of volume 198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] snapshot_file for this snap is: volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f27c24d-6bec-47a5-838d-b1a33bf0ebb6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:21 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:08:21 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:21 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 1G" returned: 0 in 1.375s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72a49341-4c52-4f98-9482-c4226ad9ec81 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:21 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72a49341-4c52-4f98-9482-c4226ad9ec81 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 Jun 26 22:08:21 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:22 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 1.160s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-198f5f42-c66c-4f51-ae2a-93fb92c53650(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:22 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7809c118-13f8-4473-98fa-bb6dadb75755]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:22 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 Jun 26 22:08:22 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:22 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72a49341-4c52-4f98-9482-c4226ad9ec81 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3" returned: 0 in 1.080s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:22 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:08:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:22 devstack sudo[103358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 Jun 26 22:08:22 devstack sudo[103358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:23 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650" returned: 0 in 1.014s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:23 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:08:23 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:23 devstack sudo[103358]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3" returned: 0 in 0.807s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:23 devstack sudo[103367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.info Jun 26 22:08:23 devstack sudo[103367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:24 devstack sudo[103367]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.info" returned: 0 in 0.770s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:24 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.info is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:08:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:24 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:24 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.info Jun 26 22:08:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 0.991s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:24 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:24 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9 Jun 26 22:08:24 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:25 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.info" returned: 0 in 0.966s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.331s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cca47b16-df55-4bd7-a376-fd84a6fa5129 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot 0ba7e7b3-5085-4252-b2b9-6433decab451: created successfully Jun 26 22:08:25 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650.e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" returned: 0 in 1.083s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-quobyte-e2354b4e-3080-4e8f-8b94-d4612ad2a0a9" released by "_delete_snapshot" :: held 4.427s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" released by "delete_snapshot" :: held 4.473s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Created reservations ['5edefc91-8ff9-4566-8d58-82a2624748f1', 'a95b55fc-caff-4426-b8ac-68575f985340', 'a9b42a5d-f42a-4f61-ab4b-0d2fa6319e6b', 'd0850450-8d46-4406-8b20-9ea1f54b47b5'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Delete snapshot completed successfully. Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-915c8aff-194c-4a62-bd6f-f02834bc0abb tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-e2354b4e-3080-4e8f-8b94-d4612ad2a0a9-delete_snapshot" released by "delete_snapshot" :: held 4.702s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot 0ba7e7b3-5085-4252-b2b9-6433decab451: deleting Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot 0ba7e7b3-5085-4252-b2b9-6433decab451: deleting {{(pid=93616) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-72a49341-4c52-4f98-9482-c4226ad9ec81" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-72a49341-4c52-4f98-9482-c4226ad9ec81" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-ded32b54-039e-40e8-83ce-fc0005daa2d3" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-ded32b54-039e-40e8-83ce-fc0005daa2d3" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Deleting offline snapshot ded32b54-039e-40e8-83ce-fc0005daa2d3 of volume 72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] snapshot_file for this snap is: volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a14516-8975-4768-a953-782cf1f121ba]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:25 devstack sudo[103388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 Jun 26 22:08:25 devstack sudo[103388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "cinder-198f5f42-c66c-4f51-ae2a-93fb92c53650-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-198f5f42-c66c-4f51-ae2a-93fb92c53650-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b833ff-e995-403c-a1b5-b8abf93f70c2]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:26 devstack sudo[103388]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3" returned: 0 in 0.893s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72a49341-4c52-4f98-9482-c4226ad9ec81(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a3054-d73d-427a-b414-f6aaa57e0753]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:26 devstack sudo[103393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 Jun 26 22:08:26 devstack sudo[103393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:26 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 Jun 26 22:08:26 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:27 devstack sudo[103393]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650" returned: 0 in 0.879s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:27 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81" returned: 0 in 0.829s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:27 devstack sudo[103404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650 Jun 26 22:08:27 devstack sudo[103404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:27 devstack sudo[103405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 Jun 26 22:08:27 devstack sudo[103405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:28 devstack sudo[103404]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-198f5f42-c66c-4f51-ae2a-93fb92c53650" returned: 0 in 0.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-quobyte-198f5f42-c66c-4f51-ae2a-93fb92c53650" released by "delete_volume" :: held 1.658s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Created reservations ['2a690db7-a1d2-4908-9098-848c0d96057a', 'c7882ca9-d6f8-4e04-8e6d-cfed4d432ab7', 'a3d97d47-6ce5-4501-8005-a5966b26ed23', '64835d31-2c4b-46ff-8d33-a6d28a015ebe'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:28 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:08:28 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:28 devstack sudo[103405]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3" returned: 0 in 0.905s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:28 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3 Jun 26 22:08:28 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:29 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.834s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:29 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:08:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Deleted volume successfully. Jun 26 22:08:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d2406788-aec6-4101-9320-a2d9f142ecb1 tempest-SnapshotsActionsTest-244014671 None] Lock "cinder-198f5f42-c66c-4f51-ae2a-93fb92c53650-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:29 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81.ded32b54-039e-40e8-83ce-fc0005daa2d3" returned: 0 in 0.926s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-ded32b54-039e-40e8-83ce-fc0005daa2d3" released by "_delete_snapshot" :: held 3.667s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-72a49341-4c52-4f98-9482-c4226ad9ec81" released by "delete_snapshot" :: held 3.694s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:29 devstack cinder-volume[93616]: WARNING cinder.quota [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1938318077 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1938318077, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:08:29 devstack cinder-volume[93616]: WARNING cinder.quota [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1938318077 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1938318077, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:08:29 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['80abd5e3-5e3c-4e69-846d-e637904ab5e7', '20c69e12-3e59-40be-928f-e7e9de18a216', '2601e8c3-7849-4b09-baa7-bb7ecd2a235b', '3a2e366c-083b-445d-afc6-5d7281fc044a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e581d2b4-d586-4657-8fe4-4c40ad4769b8 tempest-GroupSnapshotsTest-1698552620 None] group_snapshot 0ba7e7b3-5085-4252-b2b9-6433decab451: deleted successfully Jun 26 22:08:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "cinder-quobyte-72a49341-4c52-4f98-9482-c4226ad9ec81" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:08:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-72a49341-4c52-4f98-9482-c4226ad9ec81" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:08:30 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24bf8be-3cfd-404b-b431-255e101ce435]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:30 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 Jun 26 22:08:30 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:31 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81" returned: 0 in 0.926s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:31 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81 Jun 26 22:08:31 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:32 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-72a49341-4c52-4f98-9482-c4226ad9ec81" returned: 0 in 0.874s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Lock "cinder-quobyte-72a49341-4c52-4f98-9482-c4226ad9ec81" released by "delete_volume" :: held 1.911s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['22ed52e7-7650-45c3-b8dc-f649276e6205'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:32 devstack cinder-volume[93616]: WARNING cinder.quota [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1938318077 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1938318077, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Created reservations ['c727596b-4ac5-489f-a609-9d6db181a7ea', 'ddbe6e27-5d4d-4cdf-b365-b2e9e58b3567', '8898ad66-97cd-4dae-9cd8-9a54aa3183f5', '90786cb0-f417-41ed-abac-0fc0b017f6fe'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:32 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:08:32 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:33 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.698s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:33 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:08:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b0976458-8995-43f8-84ad-ec6344ce1512 tempest-GroupSnapshotsTest-1698552620 None] Delete group completed successfully. Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Flow 'volume_create_manager' (bcb053ce-07d6-4424-b055-46afa56b5031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7532ee57-a133-4801-a29d-c57dc0c2f8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7532ee57-a133-4801-a29d-c57dc0c2f8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1020693153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101add64-d4fc-4e3a-8e94-dcd5c439b62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a299290e62df4e21a2fc75c62482cbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:08:42Z,use_quota=True,user_id='48d9ae853db64a83bbbc1591d0154503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b452e478-3220-4e61-8a14-3daa2dd75503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b452e478-3220-4e61-8a14-3daa2dd75503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4de45b7-4179-40b0-ba10-53d606cfa7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4de45b7-4179-40b0-ba10-53d606cfa7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '101add64-d4fc-4e3a-8e94-dcd5c439b62b', 'volume_name': 'volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c77277-21e6-4b8c-8590-450ada7a354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54c77277-21e6-4b8c-8590-450ada7a354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe34f8d-439f-42e2-8135-398cb3fd0a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:41 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Volume 101add64-d4fc-4e3a-8e94-dcd5c439b62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b', 'volume_size': 1} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:08:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1020693153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=101add64-d4fc-4e3a-8e94-dcd5c439b62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a299290e62df4e21a2fc75c62482cbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:08:42Z,use_quota=True,user_id='48d9ae853db64a83bbbc1591d0154503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Creating volume 101add64-d4fc-4e3a-8e94-dcd5c439b62b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:08:42 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:08:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:42 devstack sudo[103558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b 1073741824 Jun 26 22:08:42 devstack sudo[103558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:43 devstack sudo[103558]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b 1073741824" returned: 0 in 1.381s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:43 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=115,cinder:SELECT=103,cinder:DELETE=2,cinder:INSERT=27 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:08:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:43 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b Jun 26 22:08:43 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:44 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b" returned: 0 in 1.122s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] <== create_volume: return (2590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:08:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.592s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fe34f8d-439f-42e2-8135-398cb3fd0a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df922b16-dbe7-429d-b736-797fe8812b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:44 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Volume volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b (101add64-d4fc-4e3a-8e94-dcd5c439b62b): created successfully Jun 26 22:08:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df922b16-dbe7-429d-b736-797fe8812b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Flow 'volume_create_manager' (bcb053ce-07d6-4424-b055-46afa56b5031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:08:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9f63e01c-d52f-4629-93b2-9e314d441466 tempest-AttachVolumeNegativeTest-1350716939 None] Created volume successfully. Jun 26 22:08:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:08:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:46 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:08:46 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:47 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.993s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:08:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:08:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:08:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:08:47 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5560ff26-4ff4-4a9a-9e1e-abc76b50865b tempest-GroupsV320Test-2058295359 None] Group tempest-GroupsV320Test-Group-1003395778: creating Jun 26 22:08:47 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5560ff26-4ff4-4a9a-9e1e-abc76b50865b tempest-GroupsV320Test-2058295359 None] Group tempest-GroupsV320Test-Group-1003395778: created successfully Jun 26 22:08:47 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5560ff26-4ff4-4a9a-9e1e-abc76b50865b tempest-GroupsV320Test-2058295359 None] Create group completed successfully. Jun 26 22:08:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-07157b9b-7297-41ce-8a0c-5c8c42e6f7e8 req-5be713b0-24f3-49b1-a522-4ef6d1e436ff tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-07157b9b-7297-41ce-8a0c-5c8c42e6f7e8 req-5be713b0-24f3-49b1-a522-4ef6d1e436ff tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f336ad7c-8128-466f-9bc5-f300b839117e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:08:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-07157b9b-7297-41ce-8a0c-5c8c42e6f7e8 req-5be713b0-24f3-49b1-a522-4ef6d1e436ff tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:48 devstack sudo[103591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b Jun 26 22:08:48 devstack sudo[103591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:49 devstack sudo[103591]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-07157b9b-7297-41ce-8a0c-5c8c42e6f7e8 req-5be713b0-24f3-49b1-a522-4ef6d1e436ff tempest-AttachVolumeNegativeTest-1350716939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b" returned: 0 in 0.933s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-07157b9b-7297-41ce-8a0c-5c8c42e6f7e8 req-5be713b0-24f3-49b1-a522-4ef6d1e436ff tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.961s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-07157b9b-7297-41ce-8a0c-5c8c42e6f7e8 req-5be713b0-24f3-49b1-a522-4ef6d1e436ff tempest-AttachVolumeNegativeTest-1350716939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6427bead-af39-430f-81bc-50df25793c25', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:08:49 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-07157b9b-7297-41ce-8a0c-5c8c42e6f7e8 req-5be713b0-24f3-49b1-a522-4ef6d1e436ff tempest-AttachVolumeNegativeTest-1350716939 None] attachment_update completed successfully. Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Created reservations ['aa038cc8-245c-4a13-9b4b-d9ecb46cd6eb'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:49 devstack sudo[103597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:08:49 devstack sudo[103597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:50 devstack sudo[103597]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.809s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:50 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:08:50 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-89959f1c-3a68-4a2a-a823-2cb4622ca34d tempest-GroupsV320Test-2058295359 None] Delete group completed successfully. Jun 26 22:08:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-8f5fc892-0af1-4116-92ab-d9dfd1919705 req-44b8a3db-7462-4d93-8e86-8417d53e0afe tempest-AttachVolumeNegativeTest-1350716939 None] Terminate volume connection completed successfully. Jun 26 22:08:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-8f5fc892-0af1-4116-92ab-d9dfd1919705 req-44b8a3db-7462-4d93-8e86-8417d53e0afe tempest-AttachVolumeNegativeTest-1350716939 None] Deleting attachment 6427bead-af39-430f-81bc-50df25793c25. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=97,cinder:UPDATE=88,cinder:DELETE=3,cinder:INSERT=24 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Flow 'volume_create_manager' (4a3436b3-46c1-4bf3-b87a-3aebb8358202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1a439b-fd82-48cc-9674-2679deaa00e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1a439b-fd82-48cc-9674-2679deaa00e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1559229180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9912f3d-a669-490b-885e-c21aa551c77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5702728ec44b0fbc675e4b34227457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:08:58Z,use_quota=True,user_id='fe954384e04b480aabda675cc441f297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141d0ae0-f7fc-4dc6-a0e0-0e7c6a01bc92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (141d0ae0-f7fc-4dc6-a0e0-0e7c6a01bc92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478ed912-ed25-46b0-8de2-d959309481fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478ed912-ed25-46b0-8de2-d959309481fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9912f3d-a669-490b-885e-c21aa551c77d', 'volume_name': 'volume-b9912f3d-a669-490b-885e-c21aa551c77d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d37e9e4-951d-46d3-b86b-177a9dcd4567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d37e9e4-951d-46d3-b86b-177a9dcd4567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3f8fb0-4c1c-4fdd-bea8-9f8a8abd7707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:08:58 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Volume b9912f3d-a669-490b-885e-c21aa551c77d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9912f3d-a669-490b-885e-c21aa551c77d', 'volume_size': 1} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:08:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1559229180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9912f3d-a669-490b-885e-c21aa551c77d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5702728ec44b0fbc675e4b34227457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:08:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:08:58Z,use_quota=True,user_id='fe954384e04b480aabda675cc441f297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Creating volume b9912f3d-a669-490b-885e-c21aa551c77d {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:08:58 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:08:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:58 devstack sudo[104038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d 1073741824 Jun 26 22:08:58 devstack sudo[104038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:08:59 devstack sudo[104038]: pam_unix(sudo:session): session closed for user root Jun 26 22:08:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d 1073741824" returned: 0 in 1.012s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:08:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:08:59 devstack sudo[104044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d Jun 26 22:08:59 devstack sudo[104044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:00 devstack sudo[104044]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d" returned: 0 in 0.908s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3f8fb0-4c1c-4fdd-bea8-9f8a8abd7707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9912f3d-a669-490b-885e-c21aa551c77d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff404a90-5ae4-4b50-ad35-0da2cd68c637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:00 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Volume volume-b9912f3d-a669-490b-885e-c21aa551c77d (b9912f3d-a669-490b-885e-c21aa551c77d): created successfully Jun 26 22:09:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff404a90-5ae4-4b50-ad35-0da2cd68c637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Flow 'volume_create_manager' (4a3436b3-46c1-4bf3-b87a-3aebb8358202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:00 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ccaf13e6-0a6a-4996-ae57-6a0da6fdcb5b tempest-VolumeQuotasAdminTestJSON-638808431 None] Created volume successfully. Jun 26 22:09:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Acquiring lock "cinder-b9912f3d-a669-490b-885e-c21aa551c77d-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "cinder-b9912f3d-a669-490b-885e-c21aa551c77d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Acquiring lock "cinder-quobyte-b9912f3d-a669-490b-885e-c21aa551c77d" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "cinder-quobyte-b9912f3d-a669-490b-885e-c21aa551c77d" acquired by "delete_volume" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:01 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da1087f-ecde-4bad-b921-6dd4655fafaf]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:01 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d Jun 26 22:09:01 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:02 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d" returned: 0 in 0.944s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:02 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d Jun 26 22:09:02 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:03 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b9912f3d-a669-490b-885e-c21aa551c77d" returned: 0 in 0.647s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "cinder-quobyte-b9912f3d-a669-490b-885e-c21aa551c77d" released by "delete_volume" :: held 1.652s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Created reservations ['738e9f78-9093-41df-8d2a-31d9d8b35172', '7cc25505-e397-46af-b28f-5028d5fa0fd8', 'd14c9e21-30c7-4167-a62e-a5c535f1daee', '5bc52cbf-297a-49cb-82e8-c3146d94a139'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:03 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:03 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:03 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.688s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Deleted volume successfully. Jun 26 22:09:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d551d08d-879a-435f-9c37-b1302a5dba73 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "cinder-b9912f3d-a669-490b-885e-c21aa551c77d-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Flow 'volume_create_manager' (4850365d-d6f4-4462-8f07-7c7e0b50f209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1752e18-8011-4553-bd63-c63fa5404c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1752e18-8011-4553-bd63-c63fa5404c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-953107473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2055f01-7191-4cad-b55d-ac28ebc7933c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5702728ec44b0fbc675e4b34227457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:04Z,use_quota=True,user_id='fe954384e04b480aabda675cc441f297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83623f3-6100-4b19-9546-7ac59fda1cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83623f3-6100-4b19-9546-7ac59fda1cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c46a717-c94d-486e-9ae5-d281bbd8db96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c46a717-c94d-486e-9ae5-d281bbd8db96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2055f01-7191-4cad-b55d-ac28ebc7933c', 'volume_name': 'volume-d2055f01-7191-4cad-b55d-ac28ebc7933c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed8f6d0-32f0-4cec-ad8e-f2ee0595533c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed8f6d0-32f0-4cec-ad8e-f2ee0595533c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bda29de-486b-48cd-b89f-4abbc3eaa8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Volume d2055f01-7191-4cad-b55d-ac28ebc7933c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2055f01-7191-4cad-b55d-ac28ebc7933c', 'volume_size': 1} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-953107473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2055f01-7191-4cad-b55d-ac28ebc7933c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5702728ec44b0fbc675e4b34227457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:04Z,use_quota=True,user_id='fe954384e04b480aabda675cc441f297',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Creating volume d2055f01-7191-4cad-b55d-ac28ebc7933c {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:04 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:04 devstack sudo[104144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c 1073741824 Jun 26 22:09:04 devstack sudo[104144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Flow 'volume_create_manager' (881ac56e-b8ab-4edf-8510-cf22fc027a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab919066-c2ec-401f-a9b5-e955f92508c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab919066-c2ec-401f-a9b5-e955f92508c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-556639428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57afc158-9e00-4875-9906-56d1dae27138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f99aff5c2eb451ebc172b06fe68cc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:05Z,use_quota=True,user_id='1d0611de61de4a7ca6dc90131a5ea284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c04c8c2-df4f-4035-9e1d-a0d3d601e1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c04c8c2-df4f-4035-9e1d-a0d3d601e1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd36592d-c3bf-4496-9865-156e4a89f87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd36592d-c3bf-4496-9865-156e4a89f87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57afc158-9e00-4875-9906-56d1dae27138', 'volume_name': 'volume-57afc158-9e00-4875-9906-56d1dae27138', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d6f845-8835-441e-a2d2-4832891f945d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04d6f845-8835-441e-a2d2-4832891f945d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcc1fef-2493-4283-bb79-357f9234f14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:04 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Volume 57afc158-9e00-4875-9906-56d1dae27138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57afc158-9e00-4875-9906-56d1dae27138', 'volume_size': 1} Jun 26 22:09:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:05 devstack sudo[104144]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c 1073741824" returned: 0 in 0.939s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:05 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c Jun 26 22:09:05 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:05 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c" returned: 0 in 0.637s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-556639428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57afc158-9e00-4875-9906-56d1dae27138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f99aff5c2eb451ebc172b06fe68cc02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:05Z,use_quota=True,user_id='1d0611de61de4a7ca6dc90131a5ea284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Creating volume 57afc158-9e00-4875-9906-56d1dae27138 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:05 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:05 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 1073741824 Jun 26 22:09:05 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bda29de-486b-48cd-b89f-4abbc3eaa8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2055f01-7191-4cad-b55d-ac28ebc7933c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622f8ea2-3f79-4549-8021-c3fd8c1f787f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:05 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Volume volume-d2055f01-7191-4cad-b55d-ac28ebc7933c (d2055f01-7191-4cad-b55d-ac28ebc7933c): created successfully Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (622f8ea2-3f79-4549-8021-c3fd8c1f787f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Flow 'volume_create_manager' (4850365d-d6f4-4462-8f07-7c7e0b50f209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:05 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-dd7b9141-6b8c-4b29-87d4-857b5ae2f182 tempest-VolumeQuotasAdminTestJSON-638808431 None] Created volume successfully. Jun 26 22:09:06 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 1073741824" returned: 0 in 0.961s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:06 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 Jun 26 22:09:06 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:07 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7a157caf-40f6-4179-be5f-451f192811b5 tempest-VolumeQuotasAdminTestJSON-1539868188 None] Transfer volume completed successfully. Jun 26 22:09:07 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138" returned: 0 in 0.692s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:07 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfcc1fef-2493-4283-bb79-357f9234f14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57afc158-9e00-4875-9906-56d1dae27138', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be03922-627d-418f-be31-6aa4bfcfeabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:07 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Volume volume-57afc158-9e00-4875-9906-56d1dae27138 (57afc158-9e00-4875-9906-56d1dae27138): created successfully Jun 26 22:09:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5be03922-627d-418f-be31-6aa4bfcfeabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Flow 'volume_create_manager' (881ac56e-b8ab-4edf-8510-cf22fc027a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:07 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8f5d8f68-f5ca-4f9b-8cf0-b20420dc9f48 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Created volume successfully. Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Acquiring lock "cinder-d2055f01-7191-4cad-b55d-ac28ebc7933c-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Lock "cinder-d2055f01-7191-4cad-b55d-ac28ebc7933c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Acquiring lock "cinder-quobyte-d2055f01-7191-4cad-b55d-ac28ebc7933c" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Lock "cinder-quobyte-d2055f01-7191-4cad-b55d-ac28ebc7933c" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[539699cc-7056-4bc0-a63c-58eff4501561]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:08 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c Jun 26 22:09:08 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:08 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c" returned: 0 in 0.763s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:08 devstack sudo[104171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c Jun 26 22:09:08 devstack sudo[104171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:09 devstack sudo[104171]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d2055f01-7191-4cad-b55d-ac28ebc7933c" returned: 0 in 0.677s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Lock "cinder-quobyte-d2055f01-7191-4cad-b55d-ac28ebc7933c" released by "delete_volume" :: held 1.498s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Created reservations ['5cfcdac0-4a40-4799-a0bf-dca1982b2a8d', '33130da3-b41b-450c-bd87-485608bbe6c3', '1a28133a-e0fd-4824-ac46-a3555ae982fa', '55a3e86a-fd84-415b-8796-d2fdac215442'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:09 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:09 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:10 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.723s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:10 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Deleted volume successfully. Jun 26 22:09:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5f7a8900-577f-4f98-8714-b39918fbda91 tempest-VolumeQuotasAdminTestJSON-1256036678 None] Lock "cinder-d2055f01-7191-4cad-b55d-ac28ebc7933c-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-45b21a97-a707-4979-a0d6-08e57224eec3 req-6c7a97b4-b16b-4f42-9d6c-106e997d7288 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-45b21a97-a707-4979-a0d6-08e57224eec3 req-6c7a97b4-b16b-4f42-9d6c-106e997d7288 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:11 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb1768f-b161-447f-9bac-26f6f133c7c3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45b21a97-a707-4979-a0d6-08e57224eec3 req-6c7a97b4-b16b-4f42-9d6c-106e997d7288 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:11 devstack sudo[104196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 Jun 26 22:09:11 devstack sudo[104196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:12 devstack sudo[104196]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-45b21a97-a707-4979-a0d6-08e57224eec3 req-6c7a97b4-b16b-4f42-9d6c-106e997d7288 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138" returned: 0 in 0.836s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-45b21a97-a707-4979-a0d6-08e57224eec3 req-6c7a97b4-b16b-4f42-9d6c-106e997d7288 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.864s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-45b21a97-a707-4979-a0d6-08e57224eec3 req-6c7a97b4-b16b-4f42-9d6c-106e997d7288 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-57afc158-9e00-4875-9906-56d1dae27138', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b31088a-d58c-440f-8855-fc3f5527082b', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:09:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-45b21a97-a707-4979-a0d6-08e57224eec3 req-6c7a97b4-b16b-4f42-9d6c-106e997d7288 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] attachment_update completed successfully. Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Flow 'volume_create_manager' (096ab570-db97-40b0-a5f4-378e9fef3235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b46bf81-c7ea-4a7e-b4a8-e278e162fb76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b46bf81-c7ea-4a7e-b4a8-e278e162fb76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1268254942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff452c0-e031-4f6d-8143-115612b6a00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87fedc4b3ca74e0aa81155a5299677b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:20Z,use_quota=True,user_id='981f5560c0d54f8eb90df4829ae0fb13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c63c566-b03c-435b-a6d3-5fc77e7b1cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c63c566-b03c-435b-a6d3-5fc77e7b1cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e90a36-bc08-4e5b-8efe-b278203b2381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61e90a36-bc08-4e5b-8efe-b278203b2381) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eff452c0-e031-4f6d-8143-115612b6a00e', 'volume_name': 'volume-eff452c0-e031-4f6d-8143-115612b6a00e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c393ef-5ce3-4c74-bcf4-e2387cb27883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88c393ef-5ce3-4c74-bcf4-e2387cb27883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa371b4-8fc9-47ba-b83d-85a10e6cf585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:19 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Volume eff452c0-e031-4f6d-8143-115612b6a00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eff452c0-e031-4f6d-8143-115612b6a00e', 'volume_size': 1} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1268254942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eff452c0-e031-4f6d-8143-115612b6a00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87fedc4b3ca74e0aa81155a5299677b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:20Z,use_quota=True,user_id='981f5560c0d54f8eb90df4829ae0fb13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Creating volume eff452c0-e031-4f6d-8143-115612b6a00e {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:19 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:20 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e 1073741824 Jun 26 22:09:20 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Flow 'volume_create_manager' (4b5472b6-ac98-406a-822a-aa03e6159e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c6f853-286f-4e91-8a20-df13a26187f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c6f853-286f-4e91-8a20-df13a26187f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-640926639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf3a3b9-2cf8-4dd8-947c-48c55ae76948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ad35a190f74788ab57b62e3aa8e8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:20Z,use_quota=True,user_id='9dc1fb3503d743c6ae061aeb0e91be0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad38eb-53ed-4a90-9782-6df9d109f8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5ad38eb-53ed-4a90-9782-6df9d109f8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5f6c07-0211-4249-bb8d-2cce01be458d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5f6c07-0211-4249-bb8d-2cce01be458d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdf3a3b9-2cf8-4dd8-947c-48c55ae76948', 'volume_name': 'volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692de687-0532-40a4-b5cb-7e92f894c925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (692de687-0532-40a4-b5cb-7e92f894c925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be6ae8e-ab9e-4333-90f5-1338834a0ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:20 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Volume fdf3a3b9-2cf8-4dd8-947c-48c55ae76948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948', 'volume_size': 1} Jun 26 22:09:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:21 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e 1073741824" returned: 0 in 1.024s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:21 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e Jun 26 22:09:21 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:21 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-2e952283-4a94-47fe-9dec-ac1c9f876600 req-61d9e393-b3fc-4cc9-b55a-0df13880b6df tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Terminate volume connection completed successfully. Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-2e952283-4a94-47fe-9dec-ac1c9f876600 req-61d9e393-b3fc-4cc9-b55a-0df13880b6df tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Deleting attachment 6b31088a-d58c-440f-8855-fc3f5527082b. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:09:21 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e" returned: 0 in 0.666s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-640926639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdf3a3b9-2cf8-4dd8-947c-48c55ae76948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ad35a190f74788ab57b62e3aa8e8c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:20Z,use_quota=True,user_id='9dc1fb3503d743c6ae061aeb0e91be0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Creating volume fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:21 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:21 devstack sudo[104646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 1073741824 Jun 26 22:09:21 devstack sudo[104646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aa371b4-8fc9-47ba-b83d-85a10e6cf585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eff452c0-e031-4f6d-8143-115612b6a00e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12e206c-48df-4eb4-9631-3ef63b7d8637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:21 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Volume volume-eff452c0-e031-4f6d-8143-115612b6a00e (eff452c0-e031-4f6d-8143-115612b6a00e): created successfully Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e12e206c-48df-4eb4-9631-3ef63b7d8637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Flow 'volume_create_manager' (096ab570-db97-40b0-a5f4-378e9fef3235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:21 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-15a0879c-1cd5-4731-aa8e-c90e219d2a67 tempest-VolumesServicesTestJSON-1641074626 None] Created volume successfully. Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Acquiring lock "cinder-eff452c0-e031-4f6d-8143-115612b6a00e-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Lock "cinder-eff452c0-e031-4f6d-8143-115612b6a00e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Acquiring lock "cinder-quobyte-eff452c0-e031-4f6d-8143-115612b6a00e" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Lock "cinder-quobyte-eff452c0-e031-4f6d-8143-115612b6a00e" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[06757b13-7189-4ddb-9d13-406309b7186f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:22 devstack sudo[104651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e Jun 26 22:09:22 devstack sudo[104651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:22 devstack sudo[104646]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 1073741824" returned: 0 in 0.883s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:22 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 Jun 26 22:09:22 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:23 devstack sudo[104651]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e" returned: 0 in 0.797s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:23 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e Jun 26 22:09:23 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:23 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Acquiring lock "cinder-57afc158-9e00-4875-9906-56d1dae27138-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948" returned: 0 in 0.745s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8be6ae8e-ab9e-4333-90f5-1338834a0ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a3137f-f23c-4cb3-932b-add3792dfaf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "cinder-57afc158-9e00-4875-9906-56d1dae27138-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Volume volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 (fdf3a3b9-2cf8-4dd8-947c-48c55ae76948): created successfully Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a3137f-f23c-4cb3-932b-add3792dfaf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Flow 'volume_create_manager' (4b5472b6-ac98-406a-822a-aa03e6159e74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-97f8ed08-3b28-4666-83b0-313933b3b940 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Created volume successfully. Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Acquiring lock "cinder-quobyte-57afc158-9e00-4875-9906-56d1dae27138" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "cinder-quobyte-57afc158-9e00-4875-9906-56d1dae27138" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3663d5a-c018-4159-b0c7-5c3923518503]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:23 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 Jun 26 22:09:23 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:23 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eff452c0-e031-4f6d-8143-115612b6a00e" returned: 0 in 0.736s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Lock "cinder-quobyte-eff452c0-e031-4f6d-8143-115612b6a00e" released by "delete_volume" :: held 1.593s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:23 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Created reservations ['c820fd06-adb9-4249-a4e6-47bd1d7c75c1', '19703bec-c4a1-4bef-a6cd-a613c065d05e', '17498ba9-59aa-4581-a565-4fd839abe3bf', '069c8fd6-3d4b-4b86-9c90-a9ce0252430d'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:24 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:24 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:24 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138" returned: 0 in 0.942s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:24 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138 Jun 26 22:09:24 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:24 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Deleted volume successfully. Jun 26 22:09:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c50ab077-b190-4c05-9827-c120dbdc2a40 tempest-VolumesServicesTestJSON-1641074626 None] Lock "cinder-eff452c0-e031-4f6d-8143-115612b6a00e-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Acquiring lock "cinder-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "cinder-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Acquiring lock "cinder-quobyte-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "cinder-quobyte-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e6eee-4d9b-41ff-88c9-11dcacccb8e1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:25 devstack sudo[104691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 Jun 26 22:09:25 devstack sudo[104691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:25 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-57afc158-9e00-4875-9906-56d1dae27138" returned: 0 in 1.147s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "cinder-quobyte-57afc158-9e00-4875-9906-56d1dae27138" released by "delete_volume" :: held 2.173s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Created reservations ['c559876b-1384-4cf7-a61a-b19dfe7d3b73', '0d9fa2fc-821d-453a-9ff6-f84b3a3b0a1d', '0b3cbbc1-686c-4886-a4e5-0efacf282841', '510fe3c4-0f84-41b3-b46d-6367aa64168e'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:26 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:26 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:26 devstack sudo[104691]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948" returned: 0 in 1.219s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:26 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948 Jun 26 22:09:26 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:27 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.443s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:27 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:27 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Deleted volume successfully. Jun 26 22:09:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf725271-81e5-4594-ab09-e664347659c7 tempest-TestServerVolumeAttachScenarioOldVersion-1101601362 None] Lock "cinder-57afc158-9e00-4875-9906-56d1dae27138-delete_volume" released by "delete_volume" :: held 3.970s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:27 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948" returned: 0 in 1.343s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "cinder-quobyte-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948" released by "delete_volume" :: held 2.639s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:27 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Created reservations ['ae509416-340b-4cc8-ba35-573b7619aef0', 'de2d0042-828c-48ee-bc28-70ed9230afaa', '36d0b92b-25a9-4e66-93df-e7840976e98b', '7bfb605f-ca8e-4005-972e-7e4b55774b31'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:09:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:28 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:28 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:30 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.972s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:30 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:30 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Deleted volume successfully. Jun 26 22:09:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-97ef7178-140c-4d62-9f43-4d51e2166b61 tempest-VolumeQuotasNegativeTestJSON-67517853 None] Lock "cinder-fdf3a3b9-2cf8-4dd8-947c-48c55ae76948-delete_volume" released by "delete_volume" :: held 5.029s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:38 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=74,cinder:DELETE=7,cinder:SELECT=52,cinder:INSERT=9 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:09:39 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Flow 'volume_create_manager' (efedd999-db42-4dd4-b4b3-fc32cb27bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a096371-42d0-4362-afc0-c02b2608288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a096371-42d0-4362-afc0-c02b2608288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-791298171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ab414b-3894-4fd0-8072-eed61309acb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dd52a111c74b5592dd9bb18f06a879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:40Z,use_quota=True,user_id='16bbd4b0f7924e34b21f9a17a735d18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d9f5f6-3848-4282-8c69-ba290f8ab1dd),volume_type_id=28d9f5f6-3848-4282-8c69-ba290f8ab1dd)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5da6a10-d480-41f7-a06e-6ea082d7473e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5da6a10-d480-41f7-a06e-6ea082d7473e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c6cac1-8d92-4ee1-84f3-aff787df15be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01c6cac1-8d92-4ee1-84f3-aff787df15be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ab414b-3894-4fd0-8072-eed61309acb2', 'volume_name': 'volume-b4ab414b-3894-4fd0-8072-eed61309acb2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833ade7d-62b2-4a56-9822-14a03c22ea8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (833ade7d-62b2-4a56-9822-14a03c22ea8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3201b903-3f7d-4cae-b07d-339b7db0f835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:40 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Volume b4ab414b-3894-4fd0-8072-eed61309acb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ab414b-3894-4fd0-8072-eed61309acb2', 'volume_size': 1} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-791298171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ab414b-3894-4fd0-8072-eed61309acb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7dd52a111c74b5592dd9bb18f06a879',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:40Z,use_quota=True,user_id='16bbd4b0f7924e34b21f9a17a735d18e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(28d9f5f6-3848-4282-8c69-ba290f8ab1dd),volume_type_id=28d9f5f6-3848-4282-8c69-ba290f8ab1dd)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Creating volume b4ab414b-3894-4fd0-8072-eed61309acb2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:40 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:40 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 1073741824 Jun 26 22:09:40 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Flow 'volume_create_manager' (e6617e15-837b-4384-81df-0645b1013f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aec723-8534-47cd-8794-74c7440a0202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6aec723-8534-47cd-8794-74c7440a0202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1210518261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622eb304-d8f2-4c95-8e39-2ff4855167ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fa3873bc82497baa61c2c4742d43bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:41Z,use_quota=True,user_id='f364ab38a1be482d8c7918c7fa7df180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f8e081-ac18-498d-beb7-c5859e29358b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45f8e081-ac18-498d-beb7-c5859e29358b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cf36cd-700f-4ed9-9b2a-77bed928db0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2cf36cd-700f-4ed9-9b2a-77bed928db0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '622eb304-d8f2-4c95-8e39-2ff4855167ff', 'volume_name': 'volume-622eb304-d8f2-4c95-8e39-2ff4855167ff', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d9f30c-f658-4833-ba1c-ec4c17febf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76d9f30c-f658-4833-ba1c-ec4c17febf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf41f03-fd49-4ca5-9653-6b0bc41ec165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:41 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Volume 622eb304-d8f2-4c95-8e39-2ff4855167ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-622eb304-d8f2-4c95-8e39-2ff4855167ff', 'volume_size': 1} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:41 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 1073741824" returned: 0 in 1.110s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:41 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 Jun 26 22:09:41 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:41 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2" returned: 0 in 0.681s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.789s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1210518261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=622eb304-d8f2-4c95-8e39-2ff4855167ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90fa3873bc82497baa61c2c4742d43bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:41Z,use_quota=True,user_id='f364ab38a1be482d8c7918c7fa7df180',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Creating volume 622eb304-d8f2-4c95-8e39-2ff4855167ff {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:41 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:41 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff 1073741824 Jun 26 22:09:41 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3201b903-3f7d-4cae-b07d-339b7db0f835) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ab414b-3894-4fd0-8072-eed61309acb2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864b2d1c-84e7-4855-a568-b8348d9856a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:42 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Volume volume-b4ab414b-3894-4fd0-8072-eed61309acb2 (b4ab414b-3894-4fd0-8072-eed61309acb2): created successfully Jun 26 22:09:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (864b2d1c-84e7-4855-a568-b8348d9856a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Flow 'volume_create_manager' (efedd999-db42-4dd4-b4b3-fc32cb27bc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:42 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3e3320b4-ba2f-4001-9e58-a6fc2906f7fd tempest-VolumeTypesAccessTest-13692711 None] Created volume successfully. Jun 26 22:09:42 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff 1073741824" returned: 0 in 0.862s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:42 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff Jun 26 22:09:42 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Acquiring lock "cinder-b4ab414b-3894-4fd0-8072-eed61309acb2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Lock "cinder-b4ab414b-3894-4fd0-8072-eed61309acb2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Acquiring lock "cinder-quobyte-b4ab414b-3894-4fd0-8072-eed61309acb2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Lock "cinder-quobyte-b4ab414b-3894-4fd0-8072-eed61309acb2" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56da857-01f1-4dc8-bb0c-34d504688916]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:43 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 Jun 26 22:09:43 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:43 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff" returned: 0 in 0.773s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bf41f03-fd49-4ca5-9653-6b0bc41ec165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-622eb304-d8f2-4c95-8e39-2ff4855167ff', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6167958-9f31-43e2-8749-b356c7c42af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:43 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Volume volume-622eb304-d8f2-4c95-8e39-2ff4855167ff (622eb304-d8f2-4c95-8e39-2ff4855167ff): created successfully Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6167958-9f31-43e2-8749-b356c7c42af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Flow 'volume_create_manager' (e6617e15-837b-4384-81df-0645b1013f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f9e7eb76-a6ce-4c60-9314-baa2cc0e5605 tempest-VolumesMetadataTest-399677862 None] Created volume successfully. Jun 26 22:09:44 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2" returned: 0 in 0.868s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:44 devstack sudo[104877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2 Jun 26 22:09:44 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Acquiring lock "cinder-622eb304-d8f2-4c95-8e39-2ff4855167ff-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Lock "cinder-622eb304-d8f2-4c95-8e39-2ff4855167ff-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Acquiring lock "cinder-quobyte-622eb304-d8f2-4c95-8e39-2ff4855167ff" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:09:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Lock "cinder-quobyte-622eb304-d8f2-4c95-8e39-2ff4855167ff" acquired by "delete_volume" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[17605a29-83d2-48f2-9bfc-035d11b837c0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:45 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b4ab414b-3894-4fd0-8072-eed61309acb2" returned: 0 in 0.852s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Lock "cinder-quobyte-b4ab414b-3894-4fd0-8072-eed61309acb2" released by "delete_volume" :: held 1.783s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:45 devstack cinder-volume[93616]: WARNING cinder.quota [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-26931143 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-26931143, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:09:45 devstack cinder-volume[93616]: WARNING cinder.quota [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-26931143 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-26931143, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Created reservations ['f2ffbb7a-84be-4bf4-8303-dd80f21747a7', '0babbd0a-dd94-47cc-8fb8-dec290c5116a', '839ae6c3-e768-4da4-b289-e6f858cec64a', '7c4c019b-bc8a-428f-a8e3-a9d38414e5df'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:09:45 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:45 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:45 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:45 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:46 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.028s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Deleted volume successfully. Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34f3368a-f14f-4a22-af26-d11a5204a314 tempest-VolumeTypesAccessTest-13692711 None] Lock "cinder-b4ab414b-3894-4fd0-8072-eed61309acb2-delete_volume" released by "delete_volume" :: held 3.101s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:46 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:46 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:46 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff" returned: 0 in 1.443s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:46 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff Jun 26 22:09:46 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:47 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.101s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:09:47 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-622eb304-d8f2-4c95-8e39-2ff4855167ff" returned: 0 in 1.049s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Lock "cinder-quobyte-622eb304-d8f2-4c95-8e39-2ff4855167ff" released by "delete_volume" :: held 2.545s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Created reservations ['c363c3f1-2bd3-4683-af3b-fa242763ebef', 'c48b58b7-e6ae-49f9-9ad9-b12c6b6b328f', '597e9999-55ff-4442-82eb-796078635f5d', '4ca0e3ca-ddcc-4a3e-9368-15f6b6e6a98e'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:47 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:09:47 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:48 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.017s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:48 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:09:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Deleted volume successfully. Jun 26 22:09:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1103aa00-cfec-4895-ac3d-cce3cedff287 tempest-VolumesMetadataTest-399677862 None] Lock "cinder-622eb304-d8f2-4c95-8e39-2ff4855167ff-delete_volume" released by "delete_volume" :: held 3.828s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Flow 'volume_create_manager' (239b6a2d-8b19-4ef3-8697-216aa1636c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8af4228-0da2-44e2-81bd-eb16c42f0557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8af4228-0da2-44e2-81bd-eb16c42f0557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-123081719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10253dd-c06b-424a-9921-2fd8a15a3ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a299290e62df4e21a2fc75c62482cbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:52Z,use_quota=True,user_id='48d9ae853db64a83bbbc1591d0154503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53d40c6-1f92-47fe-9cb4-6d7b6da5d2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c53d40c6-1f92-47fe-9cb4-6d7b6da5d2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217dacba-e038-459a-ba69-a34a42829320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (217dacba-e038-459a-ba69-a34a42829320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10253dd-c06b-424a-9921-2fd8a15a3ca2', 'volume_name': 'volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b008a07a-f837-4b1c-8aa3-0594c38a8a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b008a07a-f837-4b1c-8aa3-0594c38a8a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c041960b-5279-41d6-866a-db559fedb163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:52 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Volume e10253dd-c06b-424a-9921-2fd8a15a3ca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2', 'volume_size': 1} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-123081719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e10253dd-c06b-424a-9921-2fd8a15a3ca2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a299290e62df4e21a2fc75c62482cbbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:52Z,use_quota=True,user_id='48d9ae853db64a83bbbc1591d0154503',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Creating volume e10253dd-c06b-424a-9921-2fd8a15a3ca2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:52 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:52 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 1073741824 Jun 26 22:09:52 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:53 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 1073741824" returned: 0 in 1.002s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:53 devstack sudo[104907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 Jun 26 22:09:53 devstack sudo[104907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Flow 'volume_create_manager' (cb4fd7a5-7300-47b9-9626-aae86e6bfce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3918b531-237e-4ad3-ab34-3e784aac6e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3918b531-237e-4ad3-ab34-3e784aac6e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1349859992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1313d8-fc73-40cf-802a-3ac5b6753f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14729f30e424731abb7a6898b41ee8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:54Z,use_quota=True,user_id='880b2eaf0bf04bfa8b12e497095371b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b21ecb-afdb-49b9-b225-6bb347a55bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b21ecb-afdb-49b9-b225-6bb347a55bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8efbfb-c18b-4707-860d-8a2bd1e0c5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b8efbfb-c18b-4707-860d-8a2bd1e0c5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb1313d8-fc73-40cf-802a-3ac5b6753f0b', 'volume_name': 'volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3111d299-6d8b-4f24-91a0-a138f1ebc621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3111d299-6d8b-4f24-91a0-a138f1ebc621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc59f3b5-4160-43e3-89c0-31a1c166f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Volume bb1313d8-fc73-40cf-802a-3ac5b6753f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b', 'volume_size': 1} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:54 devstack sudo[104907]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2" returned: 0 in 1.073s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.137s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.292s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1349859992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb1313d8-fc73-40cf-802a-3ac5b6753f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d14729f30e424731abb7a6898b41ee8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:54Z,use_quota=True,user_id='880b2eaf0bf04bfa8b12e497095371b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Creating volume bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:54 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:54 devstack sudo[104911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b 1073741824 Jun 26 22:09:54 devstack sudo[104911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c041960b-5279-41d6-866a-db559fedb163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a9ef68-6503-461e-98ce-eff0875e5896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Volume volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 (e10253dd-c06b-424a-9921-2fd8a15a3ca2): created successfully Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9a9ef68-6503-461e-98ce-eff0875e5896) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Flow 'volume_create_manager' (239b6a2d-8b19-4ef3-8697-216aa1636c24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Flow 'volume_create_manager' (c50cba41-f335-4c66-b075-6b7d053abce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8f4650-2b51-4936-89a7-68e22d80f142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-55f7cecd-99f5-45f0-aa71-351cb5e39f2e tempest-AttachVolumeNegativeTest-1350716939 None] Created volume successfully. Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f8f4650-2b51-4936-89a7-68e22d80f142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1567662073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309b0148-5640-4406-9f58-4fa11d6c7473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca615c43b9249fba0cfddf50d7d1d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:54Z,use_quota=True,user_id='71ccc91deb594691b0c142aea870279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b5ebb0-8311-49c1-8ce6-5eefb4b99342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05b5ebb0-8311-49c1-8ce6-5eefb4b99342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3913e9f2-6a36-4eb7-8278-4639cabd47b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3913e9f2-6a36-4eb7-8278-4639cabd47b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '309b0148-5640-4406-9f58-4fa11d6c7473', 'volume_name': 'volume-309b0148-5640-4406-9f58-4fa11d6c7473', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d430af-9009-4915-8b67-722a8496f78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d430af-9009-4915-8b67-722a8496f78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f33b95-ccc7-4231-9c57-ab3f50811b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Volume 309b0148-5640-4406-9f58-4fa11d6c7473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-309b0148-5640-4406-9f58-4fa11d6c7473', 'volume_size': 1} Jun 26 22:09:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:55 devstack sudo[104911]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b 1073741824" returned: 0 in 0.901s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:55 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b Jun 26 22:09:55 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:56 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" returned: 0 in 0.813s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.594s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:09:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1567662073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=309b0148-5640-4406-9f58-4fa11d6c7473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca615c43b9249fba0cfddf50d7d1d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:09:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:09:54Z,use_quota=True,user_id='71ccc91deb594691b0c142aea870279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Creating volume 309b0148-5640-4406-9f58-4fa11d6c7473 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:09:56 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:56 devstack sudo[104923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 1073741824 Jun 26 22:09:56 devstack sudo[104923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc59f3b5-4160-43e3-89c0-31a1c166f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f42fb6-44cf-4bb0-a002-9d29936ace63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Volume volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b (bb1313d8-fc73-40cf-802a-3ac5b6753f0b): created successfully Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16f42fb6-44cf-4bb0-a002-9d29936ace63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Flow 'volume_create_manager' (cb4fd7a5-7300-47b9-9626-aae86e6bfce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bc697074-bc37-49b2-9cfb-c3f21298eb6d tempest-SnapshotMetadataTestJSON-1363597122 None] Created volume successfully. Jun 26 22:09:57 devstack sudo[104923]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 1073741824" returned: 0 in 0.848s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:57 devstack sudo[104929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 Jun 26 22:09:57 devstack sudo[104929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:57 devstack sudo[104929]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473" returned: 0 in 0.770s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.359s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Creating offline snapshot b16a3a62-93db-419d-ad5b-136f0030d486 of volume bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2f33b95-ccc7-4231-9c57-ab3f50811b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-309b0148-5640-4406-9f58-4fa11d6c7473', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b63dbf-baf4-42d5-b560-3cd1f208facc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1ca534-5bfe-4c42-a465-35b4c7512ced]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:57 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Volume volume-309b0148-5640-4406-9f58-4fa11d6c7473 (309b0148-5640-4406-9f58-4fa11d6c7473): created successfully Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35b63dbf-baf4-42d5-b560-3cd1f208facc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:09:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Flow 'volume_create_manager' (c50cba41-f335-4c66-b075-6b7d053abce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:09:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-42a7fb77-65a5-44ec-bfb0-76147cfc981c tempest-VolumesTransfersTest-1509236908 None] Created volume successfully. Jun 26 22:09:58 devstack sudo[104932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b Jun 26 22:09:58 devstack sudo[104932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:58 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=69,cinder:INSERT=21,cinder:UPDATE=82,cinder:DELETE=8 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:09:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-077b810c-5d42-48d6-ad87-c64524a153b6 req-667db1c0-2b03-4963-bc2a-f0ee6fd7d1ad tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:09:58 devstack sudo[104932]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" returned: 0 in 0.818s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:58 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 1G Jun 26 22:09:58 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:09:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-72171bff-9931-42ad-848b-141e35611910 tempest-VolumesTransfersTest-1197696602 None] Transfer volume completed successfully. Jun 26 22:09:59 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jun 26 22:09:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 1G" returned: 0 in 0.969s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:09:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:09:59 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 Jun 26 22:09:59 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:00 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486" returned: 0 in 0.747s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:00 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 is being set with open permissions: ugo+rw Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:00 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 Jun 26 22:10:00 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Acquiring lock "cinder-309b0148-5640-4406-9f58-4fa11d6c7473-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-309b0148-5640-4406-9f58-4fa11d6c7473-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Acquiring lock "cinder-quobyte-309b0148-5640-4406-9f58-4fa11d6c7473" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-quobyte-309b0148-5640-4406-9f58-4fa11d6c7473" acquired by "delete_volume" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93139c1-9dc7-40f8-b5b0-dafcd167c3cd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:01 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 Jun 26 22:10:01 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:01 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486" returned: 0 in 0.791s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:01 devstack sudo[104962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.info Jun 26 22:10:01 devstack sudo[104962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:01 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473" returned: 0 in 0.927s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:01 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473 Jun 26 22:10:01 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:02 devstack sudo[104962]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.info" returned: 0 in 0.819s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:02 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.info is being set with open permissions: ugo+rw Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:02 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.info Jun 26 22:10:02 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:02 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-309b0148-5640-4406-9f58-4fa11d6c7473" returned: 0 in 0.685s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-quobyte-309b0148-5640-4406-9f58-4fa11d6c7473" released by "delete_volume" :: held 1.676s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Created reservations ['e7b6326e-3387-47b9-97d2-cb1a870a41cb', 'b847c560-2b82-4203-bcc5-8375764f0e91', 'd7ecd774-9a82-4a89-bced-0750edb4b291', '8605da63-b057-43d4-b614-87d9be2e72cd'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:02 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:02 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:03 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.info" returned: 0 in 0.997s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.290s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-077b810c-5d42-48d6-ad87-c64524a153b6 req-667db1c0-2b03-4963-bc2a-f0ee6fd7d1ad tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.784s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf442d4-b1f0-4994-9039-dbbab20207ad]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-077b810c-5d42-48d6-ad87-c64524a153b6 req-667db1c0-2b03-4963-bc2a-f0ee6fd7d1ad tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bbc6ba84-509c-4bc7-ad92-a7c12621ae07 tempest-SnapshotMetadataTestJSON-1363597122 None] Create snapshot completed successfully Jun 26 22:10:03 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 Jun 26 22:10:03 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:03 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.083s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Deleted volume successfully. Jun 26 22:10:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7497c44a-2d6a-46b9-9383-cb33cdda8e5d tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-309b0148-5640-4406-9f58-4fa11d6c7473-delete_volume" released by "delete_volume" :: held 3.205s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Flow 'volume_create_manager' (dc940142-0236-43f6-a2e4-c3ddb28f7140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1774212-4036-4f07-b9cc-90191ced507b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1774212-4036-4f07-b9cc-90191ced507b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1731074327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f905ef-d06f-48b9-854d-cb2f77ef945d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca615c43b9249fba0cfddf50d7d1d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:04Z,use_quota=True,user_id='71ccc91deb594691b0c142aea870279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92faa755-cfe6-4e77-9e11-d0f835be2294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92faa755-cfe6-4e77-9e11-d0f835be2294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534713ff-2510-4f8e-8dfd-342e2ce9dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (534713ff-2510-4f8e-8dfd-342e2ce9dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f905ef-d06f-48b9-854d-cb2f77ef945d', 'volume_name': 'volume-37f905ef-d06f-48b9-854d-cb2f77ef945d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f220249-5857-4318-90ff-ae383a09ed63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f220249-5857-4318-90ff-ae383a09ed63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3803a67-2e6a-458a-b8f9-3908a6ffa1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:04 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Volume 37f905ef-d06f-48b9-854d-cb2f77ef945d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f905ef-d06f-48b9-854d-cb2f77ef945d', 'volume_size': 1} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:04 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-077b810c-5d42-48d6-ad87-c64524a153b6 req-667db1c0-2b03-4963-bc2a-f0ee6fd7d1ad tempest-AttachVolumeNegativeTest-1350716939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2" returned: 0 in 1.366s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-077b810c-5d42-48d6-ad87-c64524a153b6 req-667db1c0-2b03-4963-bc2a-f0ee6fd7d1ad tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.402s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.384s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1731074327',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37f905ef-d06f-48b9-854d-cb2f77ef945d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ca615c43b9249fba0cfddf50d7d1d26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:04Z,use_quota=True,user_id='71ccc91deb594691b0c142aea870279f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Creating volume 37f905ef-d06f-48b9-854d-cb2f77ef945d {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:04 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:04 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d 1073741824 Jun 26 22:10:04 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-077b810c-5d42-48d6-ad87-c64524a153b6 req-667db1c0-2b03-4963-bc2a-f0ee6fd7d1ad tempest-AttachVolumeNegativeTest-1350716939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a020d23-8cf6-4847-bf16-a44a47b36970', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "cinder-b16a3a62-93db-419d-ad5b-136f0030d486-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:04 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-077b810c-5d42-48d6-ad87-c64524a153b6 req-667db1c0-2b03-4963-bc2a-f0ee6fd7d1ad tempest-AttachVolumeNegativeTest-1350716939 None] attachment_update completed successfully. Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-b16a3a62-93db-419d-ad5b-136f0030d486-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "cinder-quobyte-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-quobyte-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "cinder-quobyte-b16a3a62-93db-419d-ad5b-136f0030d486" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-quobyte-b16a3a62-93db-419d-ad5b-136f0030d486" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Deleting offline snapshot b16a3a62-93db-419d-ad5b-136f0030d486 of volume bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] snapshot_file for this snap is: volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7692ac-ace5-4a13-9cf5-1499ad0d1530]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:05 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 Jun 26 22:10:05 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:05 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d 1073741824" returned: 0 in 1.033s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:05 devstack sudo[105095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d Jun 26 22:10:05 devstack sudo[105095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:05 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486" returned: 0 in 0.910s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:10:05 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6161b27a-1439-45ce-8c2e-31f0a75a44ab]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:06 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b Jun 26 22:10:06 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:06 devstack sudo[105095]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d" returned: 0 in 0.999s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3803a67-2e6a-458a-b8f9-3908a6ffa1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f905ef-d06f-48b9-854d-cb2f77ef945d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b79faa8-d222-4eba-ac3b-1309915b8445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:06 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Volume volume-37f905ef-d06f-48b9-854d-cb2f77ef945d (37f905ef-d06f-48b9-854d-cb2f77ef945d): created successfully Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b79faa8-d222-4eba-ac3b-1309915b8445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Flow 'volume_create_manager' (dc940142-0236-43f6-a2e4-c3ddb28f7140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:06 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c45a46b6-ddf8-471a-9df4-c3fb6b07a846 tempest-VolumesTransfersTest-1509236908 None] Created volume successfully. Jun 26 22:10:06 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" returned: 0 in 1.031s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:06 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 Jun 26 22:10:07 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Acquiring lock "cinder-37f905ef-d06f-48b9-854d-cb2f77ef945d-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-37f905ef-d06f-48b9-854d-cb2f77ef945d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Acquiring lock "cinder-quobyte-37f905ef-d06f-48b9-854d-cb2f77ef945d" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-quobyte-37f905ef-d06f-48b9-854d-cb2f77ef945d" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b473720b-b249-4cda-95ce-2477cb94fbb9]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:07 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486" returned: 0 in 0.827s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:07 devstack sudo[105432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d Jun 26 22:10:07 devstack sudo[105432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:07 devstack sudo[105433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486 Jun 26 22:10:07 devstack sudo[105433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:08 devstack sudo[105433]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b.b16a3a62-93db-419d-ad5b-136f0030d486" returned: 0 in 0.690s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:08 devstack sudo[105432]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d" returned: 0 in 0.847s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-quobyte-b16a3a62-93db-419d-ad5b-136f0030d486" released by "_delete_snapshot" :: held 3.697s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-quobyte-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" released by "delete_snapshot" :: held 3.727s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:08 devstack sudo[105440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d Jun 26 22:10:08 devstack sudo[105440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:08 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Created reservations ['706e41fa-0cea-4667-9483-9638b03db28a', '35a48d8f-c17d-444d-a3d0-d7ebde2089b3', '634efbfd-47dd-42be-a021-d06f76c477ba', '98904eb5-7462-41d1-b6c8-fadbd98270cf'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:08 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Delete snapshot completed successfully. Jun 26 22:10:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6f6673f-0b00-4dc0-86d4-8d6f61a434f0 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-b16a3a62-93db-419d-ad5b-136f0030d486-delete_snapshot" released by "delete_snapshot" :: held 3.912s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "cinder-bb1313d8-fc73-40cf-802a-3ac5b6753f0b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-bb1313d8-fc73-40cf-802a-3ac5b6753f0b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "cinder-quobyte-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-quobyte-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:09 devstack sudo[105440]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-37f905ef-d06f-48b9-854d-cb2f77ef945d" returned: 0 in 0.846s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-quobyte-37f905ef-d06f-48b9-854d-cb2f77ef945d" released by "delete_volume" :: held 1.736s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa89b57-0ce4-474a-bf3d-1be08d4f9068]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Created reservations ['392cbf33-f587-4d6e-bec4-74b26a1df272', 'b1bf8fb3-8bb1-41d3-a251-aed6c9904fb0', '8685b328-61e1-4c8a-a6f2-168d6e768d6e', '8b7b4b7c-10a3-469a-a51d-5a9be35b6c0f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:09 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:09 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:09 devstack sudo[105445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:09 devstack sudo[105445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:10 devstack sudo[105445]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.968s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:10 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Deleted volume successfully. Jun 26 22:10:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6b388734-0f91-4572-bf6c-1ed627bc7a36 tempest-VolumesTransfersTest-1016441822 None] Lock "cinder-37f905ef-d06f-48b9-854d-cb2f77ef945d-delete_volume" released by "delete_volume" :: held 3.046s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:10 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" returned: 0 in 1.250s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:10 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b Jun 26 22:10:10 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:11 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" returned: 0 in 0.793s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-quobyte-bb1313d8-fc73-40cf-802a-3ac5b6753f0b" released by "delete_volume" :: held 2.137s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Created reservations ['7100efb1-0a98-4f82-8468-0a9a412eb71e', 'e557f21a-ef6b-4b59-b5fd-a720579f1bfa', '58fcd832-b61a-444f-8ea8-4bd4b0ecf972', '0306d530-70d4-461f-8b7a-aece1814df07'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-42f4c064-4fc7-47df-94a0-9d7813adeadd req-9eda0fe4-b6e9-401d-9a21-4e9f0e66a3f7 tempest-AttachVolumeNegativeTest-1350716939 None] Terminate volume connection completed successfully. Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-42f4c064-4fc7-47df-94a0-9d7813adeadd req-9eda0fe4-b6e9-401d-9a21-4e9f0e66a3f7 tempest-AttachVolumeNegativeTest-1350716939 None] Deleting attachment 9a020d23-8cf6-4847-bf16-a44a47b36970. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:11 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:11 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:12 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.916s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:12 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Deleted volume successfully. Jun 26 22:10:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-eaa85f8c-2d41-4f1d-9be5-282bfacb9da5 tempest-SnapshotMetadataTestJSON-1363597122 None] Lock "cinder-bb1313d8-fc73-40cf-802a-3ac5b6753f0b-delete_volume" released by "delete_volume" :: held 3.466s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Flow 'volume_create_manager' (d09092ea-6029-48e8-8e9c-d383afa9af14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a570e13-0fcb-47c5-9614-75b9b24de5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a570e13-0fcb-47c5-9614-75b9b24de5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-313163456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fe5247-812b-4f12-8b5b-4aa193aac5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186da55d17a74d1ca61b4057b8db68fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:19Z,use_quota=True,user_id='e1d9cc0f28c1499caecb85a57aa0b1e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae88463-43d4-4e7a-b6a6-a45af8549605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae88463-43d4-4e7a-b6a6-a45af8549605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422253d0-73ad-44e1-8b76-4c02e5fbce4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422253d0-73ad-44e1-8b76-4c02e5fbce4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34fe5247-812b-4f12-8b5b-4aa193aac5cd', 'volume_name': 'volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccb7bc5-f217-438b-9a87-07e1143a2027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ccb7bc5-f217-438b-9a87-07e1143a2027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49912263-886e-452a-8915-7066bb559f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:18 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Volume 34fe5247-812b-4f12-8b5b-4aa193aac5cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd', 'volume_size': 1} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-313163456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fe5247-812b-4f12-8b5b-4aa193aac5cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186da55d17a74d1ca61b4057b8db68fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:19Z,use_quota=True,user_id='e1d9cc0f28c1499caecb85a57aa0b1e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Creating volume 34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:18 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:18 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd 1073741824 Jun 26 22:10:18 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:19 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd 1073741824" returned: 0 in 0.976s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:19 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd Jun 26 22:10:19 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Flow 'volume_create_manager' (a6604404-884d-4d57-b7d3-270595801218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0870d772-0763-4e16-bbf0-544f84c2d847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0870d772-0763-4e16-bbf0-544f84c2d847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-685927896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41056b2d-8e6a-42bb-b4e4-3bfe46cf398f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3dd894c1e8b407992810da58d488a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:20Z,use_quota=True,user_id='f7b610e3df814d05a57d4322d90fefe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cbb3f6-b60b-411f-94d4-8780bdc578e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cbb3f6-b60b-411f-94d4-8780bdc578e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3f2b44-404c-4d25-8c23-901f10f47283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3f2b44-404c-4d25-8c23-901f10f47283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41056b2d-8e6a-42bb-b4e4-3bfe46cf398f', 'volume_name': 'volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b34373d-b1f0-4390-a2bc-f05d0c79d5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b34373d-b1f0-4390-a2bc-f05d0c79d5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc2100-86b5-4023-8fa3-5fbd410dbfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:20 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Volume 41056b2d-8e6a-42bb-b4e4-3bfe46cf398f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f', 'volume_size': 1} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:20 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd" returned: 0 in 0.840s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.402s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-685927896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41056b2d-8e6a-42bb-b4e4-3bfe46cf398f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3dd894c1e8b407992810da58d488a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:20Z,use_quota=True,user_id='f7b610e3df814d05a57d4322d90fefe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Creating volume 41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:20 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:20 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f 1073741824 Jun 26 22:10:20 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49912263-886e-452a-8915-7066bb559f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9085b8-0404-4653-a29c-0271ba856e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:20 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Volume volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd (34fe5247-812b-4f12-8b5b-4aa193aac5cd): created successfully Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9085b8-0404-4653-a29c-0271ba856e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Flow 'volume_create_manager' (d09092ea-6029-48e8-8e9c-d383afa9af14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:20 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5e61a64a-24d1-4548-9f71-fbb47732dac0 tempest-VolumesDeleteCascade-958686381 None] Created volume successfully. Jun 26 22:10:21 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f 1073741824" returned: 0 in 0.984s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:21 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:10:21 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:22 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 0.813s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.394s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Creating offline snapshot 145fc30c-d679-4e0f-a4fe-3415fab2ccbb of volume 34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc2100-86b5-4023-8fa3-5fbd410dbfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaccfe7-2c8b-4a51-bba5-3d2a2c5dd0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa0a742-6f2b-42b5-8610-ad390c171192]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:22 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Volume volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f (41056b2d-8e6a-42bb-b4e4-3bfe46cf398f): created successfully Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beaccfe7-2c8b-4a51-bba5-3d2a2c5dd0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Flow 'volume_create_manager' (a6604404-884d-4d57-b7d3-270595801218) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:22 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8a6c6cd0-3e3b-4d5d-b904-5dc053f5ef7a tempest-TestStampPattern-1819556658 None] Created volume successfully. Jun 26 22:10:22 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd Jun 26 22:10:22 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:23 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd" returned: 0 in 0.951s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:23 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb 1G Jun 26 22:10:23 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "cinder-e10253dd-c06b-424a-9921-2fd8a15a3ca2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-e10253dd-c06b-424a-9921-2fd8a15a3ca2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "cinder-quobyte-e10253dd-c06b-424a-9921-2fd8a15a3ca2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-quobyte-e10253dd-c06b-424a-9921-2fd8a15a3ca2" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c39e5c9-c67b-41c8-8da1-2edbc031e142]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:24 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 Jun 26 22:10:24 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:24 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb 1G" returned: 0 in 0.978s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:24 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb Jun 26 22:10:24 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:25 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb" returned: 0 in 0.953s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:25 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb is being set with open permissions: ugo+rw Jun 26 22:10:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:25 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2" returned: 0 in 1.120s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:25 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb Jun 26 22:10:25 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:25 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2 Jun 26 22:10:25 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:26 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb" returned: 0 in 0.761s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:26 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:26 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.info Jun 26 22:10:26 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e10253dd-c06b-424a-9921-2fd8a15a3ca2" returned: 0 in 0.836s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-quobyte-e10253dd-c06b-424a-9921-2fd8a15a3ca2" released by "delete_volume" :: held 2.015s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Created reservations ['5bdd1a4e-21da-4c42-b327-d4aac8550ddb', '866203d1-53cd-40a4-98f9-2c3443c3180f', 'e74d9ade-d984-4c57-b855-17b7b377c1a8', '69b2ba69-b5c5-4d02-bbea-2e43b3f7abab'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:26 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:26 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "cinder-101add64-d4fc-4e3a-8e94-dcd5c439b62b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-101add64-d4fc-4e3a-8e94-dcd5c439b62b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "cinder-quobyte-101add64-d4fc-4e3a-8e94-dcd5c439b62b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-quobyte-101add64-d4fc-4e3a-8e94-dcd5c439b62b" acquired by "delete_volume" :: waited 0.041s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b037d13-e038-4e59-a866-0c3d9742e751]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:27 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.info" returned: 0 in 0.859s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:27 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.info is being set with open permissions: ugo+rw Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:27 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.info Jun 26 22:10:27 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:27 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b Jun 26 22:10:27 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:27 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.104s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:27 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Deleted volume successfully. Jun 26 22:10:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4c6d9c6f-3fae-40f9-b82c-01724c6546ca tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-e10253dd-c06b-424a-9921-2fd8a15a3ca2-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:28 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.info" returned: 0 in 1.150s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.836s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:28 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8363d365-4cb4-40d5-8f6a-cef117bcbd23 tempest-VolumesDeleteCascade-958686381 None] Create snapshot completed successfully Jun 26 22:10:28 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b" returned: 0 in 1.328s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:28 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b Jun 26 22:10:28 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Creating offline snapshot ca167b10-48c8-47fd-973e-6227c7c3659d of volume 34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bc421d-af92-4a82-8b3c-2190e26462d0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:29 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb Jun 26 22:10:29 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:29 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-101add64-d4fc-4e3a-8e94-dcd5c439b62b" returned: 0 in 1.044s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-quobyte-101add64-d4fc-4e3a-8e94-dcd5c439b62b" released by "delete_volume" :: held 2.453s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Created reservations ['f414ca32-9490-4b95-8bdd-8127cf515c71', 'fc10288f-8410-444a-b01d-ee8bb291eb62', 'f432f297-9148-41c3-900d-6a3097796536', 'b3efed18-5f46-4e1a-a64b-a67bee27dbbe'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:29 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:29 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:30 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb" returned: 0 in 1.021s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:30 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d 1G Jun 26 22:10:30 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "cinder-8bd76c22-949f-4d4c-8ded-d71e65747f8f-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-8bd76c22-949f-4d4c-8ded-d71e65747f8f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "cinder-quobyte-8bd76c22-949f-4d4c-8ded-d71e65747f8f" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:30 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.159s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-quobyte-8bd76c22-949f-4d4c-8ded-d71e65747f8f" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:30 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Deleted volume successfully. Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d893b5e7-0a8a-43a7-b6fe-7a3ba7be2721]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d4f654c-ab56-4a77-9d68-535c198fff5c tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-101add64-d4fc-4e3a-8e94-dcd5c439b62b-delete_volume" released by "delete_volume" :: held 4.170s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:31 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d 1G" returned: 0 in 1.072s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:31 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f Jun 26 22:10:31 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:31 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d Jun 26 22:10:31 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Flow 'volume_create_manager' (46b66ef8-20a5-4174-9dcc-0a064d411d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f6d31f-af6f-4fe8-8048-151abe39245e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f6d31f-af6f-4fe8-8048-151abe39245e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213251147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6ea80-1393-4fd3-930f-06a610ae7dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e2811fdc684bf9a48cead734b7c1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:32Z,use_quota=True,user_id='b7e263d1d15041dfb637cb3cefd20354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5bb51a-04c3-4bd5-a1ed-4dbb00115d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5bb51a-04c3-4bd5-a1ed-4dbb00115d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71176ad-5c11-4c0c-a56e-3773236cb799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d71176ad-5c11-4c0c-a56e-3773236cb799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c6ea80-1393-4fd3-930f-06a610ae7dec', 'volume_name': 'volume-00c6ea80-1393-4fd3-930f-06a610ae7dec', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04eb11bc-d10a-48bc-8501-76cb8dc65cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04eb11bc-d10a-48bc-8501-76cb8dc65cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5627b65a-8e95-4156-b794-cb6b0782f8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:31 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Volume 00c6ea80-1393-4fd3-930f-06a610ae7dec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c6ea80-1393-4fd3-930f-06a610ae7dec', 'volume_size': 1} Jun 26 22:10:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:32 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d" returned: 0 in 0.912s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:32 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d is being set with open permissions: ugo+rw Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:32 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:32 devstack sudo[105658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f" returned: 0 in 1.115s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:32 devstack sudo[105658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:32 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f Jun 26 22:10:32 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:32 devstack sudo[105658]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d" returned: 0 in 0.733s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:32 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.872s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8bd76c22-949f-4d4c-8ded-d71e65747f8f" returned: 0 in 0.736s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.981s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-213251147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c6ea80-1393-4fd3-930f-06a610ae7dec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e2811fdc684bf9a48cead734b7c1bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:32Z,use_quota=True,user_id='b7e263d1d15041dfb637cb3cefd20354',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Creating volume 00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:32 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:32 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec 1073741824 Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-quobyte-8bd76c22-949f-4d4c-8ded-d71e65747f8f" released by "delete_volume" :: held 1.939s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:32 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:32 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6936db85-95c9-48b6-ab2b-00665800d6c2 tempest-VolumesDeleteCascade-958686381 None] Create snapshot completed successfully Jun 26 22:10:32 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Created reservations ['b3e511a1-370d-44f3-93b6-d6b083a8d159', 'b0a4bf09-743e-46d6-b5e6-42b09ee97e7d', 'dbeb8779-25a1-42b6-8c54-0b5d3e78044b', '15cebc45-e88e-49a1-89f5-08a71884c798'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:33 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:33 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-34fe5247-812b-4f12-8b5b-4aa193aac5cd-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-34fe5247-812b-4f12-8b5b-4aa193aac5cd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Performing cascade delete. {{(pid=93616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-145fc30c-d679-4e0f-a4fe-3415fab2ccbb-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-145fc30c-d679-4e0f-a4fe-3415fab2ccbb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-145fc30c-d679-4e0f-a4fe-3415fab2ccbb" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-145fc30c-d679-4e0f-a4fe-3415fab2ccbb" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Deleting offline snapshot 145fc30c-d679-4e0f-a4fe-3415fab2ccbb of volume 34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] snapshot_file for this snap is: volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36298eb-ea7d-420d-b8e4-8e16cafeeb50]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:33 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb Jun 26 22:10:33 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:33 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.833s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Deleted volume successfully. Jun 26 22:10:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b27369e4-5613-43cb-af00-bb6754aab157 tempest-AttachVolumeNegativeTest-1350716939 None] Lock "cinder-8bd76c22-949f-4d4c-8ded-d71e65747f8f-delete_volume" released by "delete_volume" :: held 3.090s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:34 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec 1073741824" returned: 0 in 1.161s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:34 devstack sudo[105677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:10:34 devstack sudo[105677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:34 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb" returned: 0 in 1.028s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aff0a80-a3dc-4fae-8bc3-cf49aa245808]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:34 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd Jun 26 22:10:34 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:34 devstack sudo[105677]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.795s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5627b65a-8e95-4156-b794-cb6b0782f8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c6ea80-1393-4fd3-930f-06a610ae7dec', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a306d0-520c-42ff-839e-6c9d4868998b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:34 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Volume volume-00c6ea80-1393-4fd3-930f-06a610ae7dec (00c6ea80-1393-4fd3-930f-06a610ae7dec): created successfully Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a306d0-520c-42ff-839e-6c9d4868998b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Flow 'volume_create_manager' (46b66ef8-20a5-4174-9dcc-0a064d411d8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1ae30c59-4551-479d-ab2a-38abdca52d2e tempest-VolumesActionsTest-1632732044 None] Created volume successfully. Jun 26 22:10:35 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd" returned: 0 in 0.855s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:35 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca074d3-486f-409e-b672-1e53edecd994]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:35 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d Jun 26 22:10:35 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d" returned: 0 in 0.922s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:10:36 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45ab1a2-a1b1-4cd4-807f-5d4581a54c02]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:36 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb Jun 26 22:10:36 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:37 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb" returned: 0 in 0.936s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:10:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f076e6-be2a-4c02-a8d2-38663d66c0c9]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:37 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd Jun 26 22:10:37 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:38 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd" returned: 0 in 1.195s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:38 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb Jun 26 22:10:38 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:39 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb" returned: 0 in 1.314s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:40 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb Jun 26 22:10:40 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:40 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.145fc30c-d679-4e0f-a4fe-3415fab2ccbb" returned: 0 in 0.871s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d -F qcow2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:40 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d -F qcow2 Jun 26 22:10:40 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:41 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d -F qcow2" returned: 0 in 0.976s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-145fc30c-d679-4e0f-a4fe-3415fab2ccbb" released by "_delete_snapshot" :: held 8.335s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" released by "delete_snapshot" :: held 8.364s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:41 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=82,cinder:INSERT=21,cinder:UPDATE=107,cinder:DELETE=8 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:10:41 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Created reservations ['73c82259-096f-440a-bde4-653ecfb3e217', '56b37f42-0b6c-418a-b906-61619e7de1ea', '38b288d1-d6b8-45e0-a949-1fdfa02404df', '0d6074d1-9f7a-4f8f-8a34-813e5001f36e'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:41 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Delete snapshot completed successfully. Jun 26 22:10:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-145fc30c-d679-4e0f-a4fe-3415fab2ccbb-delete_snapshot" released by "delete_snapshot" :: held 8.556s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-ca167b10-48c8-47fd-973e-6227c7c3659d-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-ca167b10-48c8-47fd-973e-6227c7c3659d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-ca167b10-48c8-47fd-973e-6227c7c3659d" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-ca167b10-48c8-47fd-973e-6227c7c3659d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Deleting offline snapshot ca167b10-48c8-47fd-973e-6227c7c3659d of volume 34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] snapshot_file for this snap is: volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eda3d8-6c98-4f6e-83ad-bf2df3e1b7d9]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:42 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d Jun 26 22:10:42 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Flow 'volume_create_manager' (ca75a7e6-dfd3-4651-86b0-8cfc85538078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce83817d-9230-4e33-bac0-cf0ee41e999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce83817d-9230-4e33-bac0-cf0ee41e999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-793016040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e451455-7129-4bb4-b770-5a177a8a3b15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2a0f49ad3b4e69b1f115e9d5eabe2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:43Z,use_quota=True,user_id='029080f161604f07bd5fa143a9b23407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58df6ab3-5b17-482b-b4f5-9d6b8af4f2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58df6ab3-5b17-482b-b4f5-9d6b8af4f2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d351f7fb-e84c-4034-9308-ac5023357983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d351f7fb-e84c-4034-9308-ac5023357983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e451455-7129-4bb4-b770-5a177a8a3b15', 'volume_name': 'volume-3e451455-7129-4bb4-b770-5a177a8a3b15', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb63f707-e786-402c-ab54-709df6997dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb63f707-e786-402c-ab54-709df6997dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5731d1-5627-4b2c-b920-b8043e71d51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:42 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Volume 3e451455-7129-4bb4-b770-5a177a8a3b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e451455-7129-4bb4-b770-5a177a8a3b15', 'volume_size': 1} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-793016040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e451455-7129-4bb4-b770-5a177a8a3b15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2a0f49ad3b4e69b1f115e9d5eabe2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:43Z,use_quota=True,user_id='029080f161604f07bd5fa143a9b23407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Creating volume 3e451455-7129-4bb4-b770-5a177a8a3b15 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:42 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:42 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 1073741824 Jun 26 22:10:42 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:43 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d" returned: 0 in 1.637s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:10:43 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d9b334-aae4-4a89-b793-bf246016c4e3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:44 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd Jun 26 22:10:44 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:44 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 1073741824" returned: 0 in 1.572s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:44 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 Jun 26 22:10:44 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:45 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:45 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd" returned: 0 in 1.774s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15" returned: 0 in 1.046s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] <== create_volume: return (2761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.768s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:45 devstack sudo[105854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d Jun 26 22:10:45 devstack sudo[105854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af5731d1-5627-4b2c-b920-b8043e71d51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e451455-7129-4bb4-b770-5a177a8a3b15', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbbb894-49ca-4c4b-ab41-275d3aa945ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:45 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Volume volume-3e451455-7129-4bb4-b770-5a177a8a3b15 (3e451455-7129-4bb4-b770-5a177a8a3b15): created successfully Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fbbb894-49ca-4c4b-ab41-275d3aa945ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Flow 'volume_create_manager' (ca75a7e6-dfd3-4651-86b0-8cfc85538078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:45 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5c0b2e03-5a8e-4201-bea9-66c8e0a10267 tempest-VolumesTestJSON-1987901539 None] Created volume successfully. Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:46 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:46 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:46 devstack sudo[105854]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d" returned: 0 in 1.143s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:46 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d Jun 26 22:10:46 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:47 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.310s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:10:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:10:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:10:48 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd.ca167b10-48c8-47fd-973e-6227c7c3659d" returned: 0 in 1.286s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-ca167b10-48c8-47fd-973e-6227c7c3659d" released by "_delete_snapshot" :: held 6.013s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" released by "delete_snapshot" :: held 6.059s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Created reservations ['366fde4a-8f8e-4358-b279-eee9e912af60', 'd6a138cc-ef98-462b-8a4e-014f83ed681b', '2b0c7321-5b45-4739-b282-92e353044d73', '99874aa5-0707-40de-aa4f-d10a7fd815a5'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Flow 'volume_create_manager' (589d1a1d-0a8a-4908-818b-c0fd71f9b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59ca25a-2778-468a-afee-a400e100e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59ca25a-2778-468a-afee-a400e100e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1947324242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1cb181-f947-451f-8580-5daa7bb0d20b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2a0f49ad3b4e69b1f115e9d5eabe2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:48Z,use_quota=True,user_id='029080f161604f07bd5fa143a9b23407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95ffc3e-8c3e-4e95-9253-ccfa2a424ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95ffc3e-8c3e-4e95-9253-ccfa2a424ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b025c084-a6b5-447e-ae7f-4dc1dfb3c342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b025c084-a6b5-447e-ae7f-4dc1dfb3c342) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1cb181-f947-451f-8580-5daa7bb0d20b', 'volume_name': 'volume-ad1cb181-f947-451f-8580-5daa7bb0d20b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85af4fc2-05f2-4c88-9150-38acdc6961d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85af4fc2-05f2-4c88-9150-38acdc6961d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3eabe16-817c-4b3e-810b-3eb93301c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:48 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Volume ad1cb181-f947-451f-8580-5daa7bb0d20b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1cb181-f947-451f-8580-5daa7bb0d20b', 'volume_size': 1} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1947324242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1cb181-f947-451f-8580-5daa7bb0d20b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2a0f49ad3b4e69b1f115e9d5eabe2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:48Z,use_quota=True,user_id='029080f161604f07bd5fa143a9b23407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Creating volume ad1cb181-f947-451f-8580-5daa7bb0d20b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:48 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:48 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b 1073741824 Jun 26 22:10:48 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Delete snapshot completed successfully. Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-ca167b10-48c8-47fd-973e-6227c7c3659d-delete_snapshot" released by "delete_snapshot" :: held 6.508s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Snapshots deleted, issuing volume delete {{(pid=93616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b08b0e21-a720-4d68-be4f-1952a2a2c9f7]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:48 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd Jun 26 22:10:48 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:49 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:49 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd" returned: 0 in 0.968s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b 1073741824" returned: 0 in 1.116s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:49 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd Jun 26 22:10:49 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:49 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b Jun 26 22:10:49 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:50 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-34fe5247-812b-4f12-8b5b-4aa193aac5cd" returned: 0 in 0.766s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-34fe5247-812b-4f12-8b5b-4aa193aac5cd" released by "delete_volume" :: held 1.803s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:50 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b" returned: 0 in 0.786s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.955s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3eabe16-817c-4b3e-810b-3eb93301c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1cb181-f947-451f-8580-5daa7bb0d20b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de997f1-3cf4-46a2-9b46-3e1ae5430719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Created reservations ['9966e778-1d68-4567-af23-4b7e2cb39eb6', '55175a4b-bcc9-4c8b-a0d2-6766594387ad', 'dd7a1c01-605f-4c30-bc6f-c9df3bea3942', '2396645e-4570-4566-9166-d84645fabecb'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:50 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Volume volume-ad1cb181-f947-451f-8580-5daa7bb0d20b (ad1cb181-f947-451f-8580-5daa7bb0d20b): created successfully Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2de997f1-3cf4-46a2-9b46-3e1ae5430719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Flow 'volume_create_manager' (589d1a1d-0a8a-4908-818b-c0fd71f9b24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:50 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fb8f014b-f4fc-4cca-a49f-5c9929f01554 tempest-VolumesTestJSON-1987901539 None] Created volume successfully. Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:50 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:50 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:51 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.629s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:51 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Deleted volume successfully. Jun 26 22:10:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-65b0a9c1-b168-47ae-a8bd-c5f7c4372bd9 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-34fe5247-812b-4f12-8b5b-4aa193aac5cd-delete_volume" released by "delete_volume" :: held 17.882s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Flow 'volume_create_manager' (22cb728f-986f-43e6-a0f0-4cddaa4ab0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e1aa64-f355-4fa6-b995-55208ae13770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95e1aa64-f355-4fa6-b995-55208ae13770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-958874916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89db293f-f628-464d-9e44-48211f4dd08b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2a0f49ad3b4e69b1f115e9d5eabe2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:53Z,use_quota=True,user_id='029080f161604f07bd5fa143a9b23407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604c3782-0791-45ef-9870-81caec5fc527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (604c3782-0791-45ef-9870-81caec5fc527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874b43b8-f12f-4ec7-937f-eb8679e24dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (874b43b8-f12f-4ec7-937f-eb8679e24dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89db293f-f628-464d-9e44-48211f4dd08b', 'volume_name': 'volume-89db293f-f628-464d-9e44-48211f4dd08b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f4ea59-9d9b-4be2-8661-3f55600d0c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98f4ea59-9d9b-4be2-8661-3f55600d0c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86323d59-fa82-4b37-a87d-ff7d2f9dc0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:52 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Volume 89db293f-f628-464d-9e44-48211f4dd08b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89db293f-f628-464d-9e44-48211f4dd08b', 'volume_size': 1} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-958874916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89db293f-f628-464d-9e44-48211f4dd08b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ce2a0f49ad3b4e69b1f115e9d5eabe2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:53Z,use_quota=True,user_id='029080f161604f07bd5fa143a9b23407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Creating volume 89db293f-f628-464d-9e44-48211f4dd08b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:52 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:52 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b 1073741824 Jun 26 22:10:52 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Flow 'volume_create_manager' (5ed22222-4876-4a17-b725-0bc8bfb6b44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951cc657-79f6-458d-90bc-bb1efd6133c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (951cc657-79f6-458d-90bc-bb1efd6133c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-846749740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066ded28-9e71-4667-b2d0-586a9e282837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186da55d17a74d1ca61b4057b8db68fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:53Z,use_quota=True,user_id='e1d9cc0f28c1499caecb85a57aa0b1e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b511e9d-2184-409f-ae2a-e918791c7a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b511e9d-2184-409f-ae2a-e918791c7a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6467a273-ceb8-4243-b52c-521383044331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6467a273-ceb8-4243-b52c-521383044331) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '066ded28-9e71-4667-b2d0-586a9e282837', 'volume_name': 'volume-066ded28-9e71-4667-b2d0-586a9e282837', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7578bc5f-f877-42d4-9ab3-2f574d57004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7578bc5f-f877-42d4-9ab3-2f574d57004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec91e71-0d80-4086-b1c6-9bc780efe163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:53 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Volume 066ded28-9e71-4667-b2d0-586a9e282837: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-066ded28-9e71-4667-b2d0-586a9e282837', 'volume_size': 1} Jun 26 22:10:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:54 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b 1073741824" returned: 0 in 1.298s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:54 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b Jun 26 22:10:54 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:54 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b" returned: 0 in 0.721s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-846749740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=066ded28-9e71-4667-b2d0-586a9e282837,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186da55d17a74d1ca61b4057b8db68fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:10:53Z,use_quota=True,user_id='e1d9cc0f28c1499caecb85a57aa0b1e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Creating volume 066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:10:54 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:54 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 1073741824 Jun 26 22:10:54 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86323d59-fa82-4b37-a87d-ff7d2f9dc0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89db293f-f628-464d-9e44-48211f4dd08b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16992a0c-6939-401c-a23c-8ea312765f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Volume volume-89db293f-f628-464d-9e44-48211f4dd08b (89db293f-f628-464d-9e44-48211f4dd08b): created successfully Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16992a0c-6939-401c-a23c-8ea312765f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Flow 'volume_create_manager' (22cb728f-986f-43e6-a0f0-4cddaa4ab0c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5830ea26-9e28-4b1f-a9e3-43ce0326355c tempest-VolumesTestJSON-1987901539 None] Created volume successfully. Jun 26 22:10:55 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 1073741824" returned: 0 in 0.976s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:55 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 Jun 26 22:10:55 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Acquiring lock "cinder-89db293f-f628-464d-9e44-48211f4dd08b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Lock "cinder-89db293f-f628-464d-9e44-48211f4dd08b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Acquiring lock "cinder-quobyte-89db293f-f628-464d-9e44-48211f4dd08b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Lock "cinder-quobyte-89db293f-f628-464d-9e44-48211f4dd08b" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-717de12c-584c-46f0-aa66-e7a30a823347 tempest-VolumesActionsTest-1632732044 None] Acquiring lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec" by "attach_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4f7371-ef76-4536-a5bc-9131e1d62139]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-717de12c-584c-46f0-aa66-e7a30a823347 tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec" acquired by "attach_volume" :: waited 0.042s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-717de12c-584c-46f0-aa66-e7a30a823347 tempest-VolumesActionsTest-1632732044 None] Attaching volume 00c6ea80-1393-4fd3-930f-06a610ae7dec to instance 49854376-1acd-4543-bcdc-b72cc1637738 at mountpoint /dev/vdb on host None. Jun 26 22:10:56 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:56 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b Jun 26 22:10:56 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837" returned: 0 in 0.826s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-717de12c-584c-46f0-aa66-e7a30a823347 tempest-VolumesActionsTest-1632732044 None] Attach volume completed successfully. Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ec91e71-0d80-4086-b1c6-9bc780efe163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-066ded28-9e71-4667-b2d0-586a9e282837', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fc6335-5aaa-4435-9365-61459c8a645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-717de12c-584c-46f0-aa66-e7a30a823347 tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec" released by "attach_volume" :: held 0.141s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Volume volume-066ded28-9e71-4667-b2d0-586a9e282837 (066ded28-9e71-4667-b2d0-586a9e282837): created successfully Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2fc6335-5aaa-4435-9365-61459c8a645f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:10:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Flow 'volume_create_manager' (5ed22222-4876-4a17-b725-0bc8bfb6b44d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:10:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-703918bf-f9e5-4bb6-9842-b7e1c5663181 tempest-VolumesDeleteCascade-958686381 None] Created volume successfully. Jun 26 22:10:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9732269-f306-4c4b-b4f0-3369f9c2212e tempest-VolumesActionsTest-1632732044 None] Acquiring lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-detach_volume" by "detach_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9732269-f306-4c4b-b4f0-3369f9c2212e tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b9732269-f306-4c4b-b4f0-3369f9c2212e tempest-VolumesActionsTest-1632732044 None] Detaching volume 00c6ea80-1393-4fd3-930f-06a610ae7dec from instance 49854376-1acd-4543-bcdc-b72cc1637738. Jun 26 22:10:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b9732269-f306-4c4b-b4f0-3369f9c2212e tempest-VolumesActionsTest-1632732044 None] Detach volume completed successfully. Jun 26 22:10:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b9732269-f306-4c4b-b4f0-3369f9c2212e tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-detach_volume" released by "detach_volume" :: held 0.056s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:57 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b" returned: 0 in 0.826s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:57 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b Jun 26 22:10:57 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:58 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-89db293f-f628-464d-9e44-48211f4dd08b" returned: 0 in 0.765s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Creating offline snapshot 43120b91-b061-4928-93d0-8385129879e9 of volume 066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Lock "cinder-quobyte-89db293f-f628-464d-9e44-48211f4dd08b" released by "delete_volume" :: held 1.662s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9763079e-ac96-445a-baf3-4bb33a341443]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Created reservations ['0ecad940-e541-4c9f-8e2f-9ccfe6cd4698', 'b029aadc-e213-42e0-8204-a52a4f178e1f', '5075b786-6196-42f9-8edb-1f3c146fe128', '93d1d3ab-f54c-4d53-93f8-a8330e5606f7'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:58 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 Jun 26 22:10:58 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:58 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:10:58 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "cinder-ad1cb181-f947-451f-8580-5daa7bb0d20b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-ad1cb181-f947-451f-8580-5daa7bb0d20b-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=101,cinder:INSERT=30,cinder:UPDATE=107,cinder:DELETE=10 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "cinder-quobyte-ad1cb181-f947-451f-8580-5daa7bb0d20b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-quobyte-ad1cb181-f947-451f-8580-5daa7bb0d20b" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[24715061-d5c3-4a9f-afdf-0e33bae51aa3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:10:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:59 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b Jun 26 22:10:59 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:59 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837" returned: 0 in 1.193s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:59 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Jun 26 22:10:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:10:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.099s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:10:59 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:10:59 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 1G Jun 26 22:10:59 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:10:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Deleted volume successfully. Jun 26 22:10:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8991a6ad-066d-4057-83fb-a0f1ca4a0d2c tempest-VolumesTestJSON-1987901539 None] Lock "cinder-89db293f-f628-464d-9e44-48211f4dd08b-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:00 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b" returned: 0 in 1.350s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:00 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b Jun 26 22:11:00 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:00 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 1G" returned: 0 in 1.021s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066ded28-9e71-4667-b2d0-586a9e282837 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:00 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066ded28-9e71-4667-b2d0-586a9e282837 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 Jun 26 22:11:00 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:01 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ad1cb181-f947-451f-8580-5daa7bb0d20b" returned: 0 in 0.796s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-quobyte-ad1cb181-f947-451f-8580-5daa7bb0d20b" released by "delete_volume" :: held 2.228s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Created reservations ['342c9662-6ea2-4ef0-85a4-e5b20bd9a05f', 'ec51017f-9879-45fb-a13c-3cee88149b07', '64934cfb-629b-4309-adb4-7195a676bda8', '4e5a5ddf-b828-4fa5-aca8-a288e02220b1'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:01 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:01 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:01 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-066ded28-9e71-4667-b2d0-586a9e282837 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9" returned: 0 in 1.019s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:01 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 is being set with open permissions: ugo+rw Jun 26 22:11:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:01 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 Jun 26 22:11:01 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:02 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.673s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:02 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Deleted volume successfully. Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5d73a59-113f-4f03-93c9-ba46acead1c9 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-ad1cb181-f947-451f-8580-5daa7bb0d20b-delete_volume" released by "delete_volume" :: held 3.305s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "cinder-3e451455-7129-4bb4-b770-5a177a8a3b15-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:02 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9" returned: 0 in 0.670s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-3e451455-7129-4bb4-b770-5a177a8a3b15-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "cinder-quobyte-3e451455-7129-4bb4-b770-5a177a8a3b15" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:02 devstack sudo[106111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.info Jun 26 22:11:02 devstack sudo[106111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-quobyte-3e451455-7129-4bb4-b770-5a177a8a3b15" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4129e420-41d1-4e21-8aec-e6713aee9ee1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:02 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 Jun 26 22:11:02 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:02 devstack sudo[106111]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.info" returned: 0 in 0.718s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:02 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.info is being set with open permissions: ugo+rw Jun 26 22:11:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:02 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.info Jun 26 22:11:02 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:03 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15" returned: 0 in 0.852s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:03 devstack sudo[106159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15 Jun 26 22:11:03 devstack sudo[106159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:03 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.info" returned: 0 in 0.670s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.441s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b65ca0e1-7cb4-4169-9fae-a9e374b7e60d tempest-VolumesDeleteCascade-958686381 None] Create snapshot completed successfully Jun 26 22:11:03 devstack sudo[106159]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3e451455-7129-4bb4-b770-5a177a8a3b15" returned: 0 in 0.696s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-quobyte-3e451455-7129-4bb4-b770-5a177a8a3b15" released by "delete_volume" :: held 1.613s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Created reservations ['4b23d1c2-46df-4110-84bd-8b0f55aab941', 'f9731137-63a1-4cc4-8119-7bbff48a3743', '04e0ddb2-0bea-4436-b5aa-b5d7baacccac', '1db6babe-cd08-432d-aa8e-62452f05e4e3'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:03 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:03 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:04 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.665s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:04 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:04 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Deleted volume successfully. Jun 26 22:11:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f5bc255c-fa2d-4ef7-9456-9c8ee4e192e0 tempest-VolumesTestJSON-1987901539 None] Lock "cinder-3e451455-7129-4bb4-b770-5a177a8a3b15-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Flow 'volume_create_manager' (22bca901-7782-4938-b428-5d687854e5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f88e15-0761-4d19-b77b-a7bed45ddeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f88e15-0761-4d19-b77b-a7bed45ddeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-895332678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b2e1512-ebcc-4d14-aab3-16a61610cea6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='186da55d17a74d1ca61b4057b8db68fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=43120b91-b061-4928-93d0-8385129879e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:05Z,use_quota=True,user_id='e1d9cc0f28c1499caecb85a57aa0b1e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a723a03b-6deb-4c3d-b04c-abb50c1ecfda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a723a03b-6deb-4c3d-b04c-abb50c1ecfda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635b45a0-00d6-4c03-a295-05b379f056d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (635b45a0-00d6-4c03-a295-05b379f056d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b2e1512-ebcc-4d14-aab3-16a61610cea6', 'volume_name': 'volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6', 'volume_size': 1, 'snapshot_id': '43120b91-b061-4928-93d0-8385129879e9'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331c9f82-0db6-40a0-a5ce-b1d264d0d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (331c9f82-0db6-40a0-a5ce-b1d264d0d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004251ac-b9bd-46f5-882a-f049a1d9b778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:05 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Volume 5b2e1512-ebcc-4d14-aab3-16a61610cea6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6', 'volume_size': 1, 'snapshot_id': '43120b91-b061-4928-93d0-8385129879e9'} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-43120b91-b061-4928-93d0-8385129879e9-5b2e1512-ebcc-4d14-aab3-16a61610cea6" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-43120b91-b061-4928-93d0-8385129879e9-5b2e1512-ebcc-4d14-aab3-16a61610cea6" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Creating volume 5b2e1512-ebcc-4d14-aab3-16a61610cea6 from snapshot 43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-5b2e1512-ebcc-4d14-aab3-16a61610cea6" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-5b2e1512-ebcc-4d14-aab3-16a61610cea6" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] snapshot: 43120b91-b061-4928-93d0-8385129879e9, volume: 5b2e1512-ebcc-4d14-aab3-16a61610cea6, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dbf8dd-27a3-4f06-8095-b1e7af8dd47e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:05 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 Jun 26 22:11:05 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-cd940970-5941-409e-997a-10193a95acf9 req-c0731b69-7f7c-4b47-b9a8-282135c0a041 tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:06 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9" returned: 0 in 1.066s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-066ded28-9e71-4667-b2d0-586a9e282837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:11:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:11:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:11:06 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d704a6-bcb1-42f8-b4e8-3feb232b8c6f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:06 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 Jun 26 22:11:06 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:07 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837" returned: 0 in 0.848s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:07 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:11:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:07 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 Jun 26 22:11:07 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:12 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6" returned: 0 in 5.575s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:13 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb9640b-b7af-49b3-840c-55e25b8a2235]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:13 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 Jun 26 22:11:13 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:14 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837" returned: 0 in 1.218s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:14 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:11:14 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Converted 1024.00 MB image at 183.64 MB/s Jun 26 22:11:14 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 is being set with open permissions: ugo+rw Jun 26 22:11:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:14 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 Jun 26 22:11:14 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:15 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6" returned: 0 in 0.825s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-5b2e1512-ebcc-4d14-aab3-16a61610cea6" released by "_copy_volume_from_snapshot" :: held 9.671s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-43120b91-b061-4928-93d0-8385129879e9-5b2e1512-ebcc-4d14-aab3-16a61610cea6" released by "_create_volume_from_snapshot" :: held 9.721s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.743s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-cd940970-5941-409e-997a-10193a95acf9 req-c0731b69-7f7c-4b47-b9a8-282135c0a041 tempest-TestStampPattern-1819556658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 9.386s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4800e1aa-f3d4-4f67-b9b6-1a72797475c0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-cd940970-5941-409e-997a-10193a95acf9 req-c0731b69-7f7c-4b47-b9a8-282135c0a041 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004251ac-b9bd-46f5-882a-f049a1d9b778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6', 'volume_size': 1, 'snapshot_id': '43120b91-b061-4928-93d0-8385129879e9'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c13733e-d349-47bc-bc8e-f69a4c7c66c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Volume volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 (5b2e1512-ebcc-4d14-aab3-16a61610cea6): created successfully Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c13733e-d349-47bc-bc8e-f69a4c7c66c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Flow 'volume_create_manager' (22bca901-7782-4938-b428-5d687854e5c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5c54b8fb-a1a4-4fc7-a71e-36a79706d0bd tempest-VolumesDeleteCascade-958686381 None] Created volume successfully. Jun 26 22:11:15 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:11:15 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:15 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-cd940970-5941-409e-997a-10193a95acf9 req-c0731b69-7f7c-4b47-b9a8-282135c0a041 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 0.872s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-cd940970-5941-409e-997a-10193a95acf9 req-c0731b69-7f7c-4b47-b9a8-282135c0a041 tempest-TestStampPattern-1819556658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.902s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-cd940970-5941-409e-997a-10193a95acf9 req-c0731b69-7f7c-4b47-b9a8-282135c0a041 tempest-TestStampPattern-1819556658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd3336ef1-5f56-41b0-b582-ab3bed7dac4e', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-066ded28-9e71-4667-b2d0-586a9e282837-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-066ded28-9e71-4667-b2d0-586a9e282837-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:16 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-cd940970-5941-409e-997a-10193a95acf9 req-c0731b69-7f7c-4b47-b9a8-282135c0a041 tempest-TestStampPattern-1819556658 None] attachment_update completed successfully. Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Performing cascade delete. {{(pid=93616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-43120b91-b061-4928-93d0-8385129879e9-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-43120b91-b061-4928-93d0-8385129879e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-066ded28-9e71-4667-b2d0-586a9e282837" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-066ded28-9e71-4667-b2d0-586a9e282837" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-43120b91-b061-4928-93d0-8385129879e9" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-43120b91-b061-4928-93d0-8385129879e9" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Deleting offline snapshot 43120b91-b061-4928-93d0-8385129879e9 of volume 066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] snapshot_file for this snap is: volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1be0a4-41af-453e-a15b-5176c693b2ee]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:16 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 Jun 26 22:11:16 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:17 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9" returned: 0 in 0.973s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-066ded28-9e71-4667-b2d0-586a9e282837(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:11:17 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb54bc5-01cd-482d-be95-e8e7ca1ebea0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:17 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 Jun 26 22:11:17 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b24d7ab8-5eb8-4e6d-b676-ea797be32004 tempest-GroupsTest-623370835 None] Group tempest-Group1-1139296356: creating Jun 26 22:11:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b24d7ab8-5eb8-4e6d-b676-ea797be32004 tempest-GroupsTest-623370835 None] Group tempest-Group1-1139296356: created successfully Jun 26 22:11:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b24d7ab8-5eb8-4e6d-b676-ea797be32004 tempest-GroupsTest-623370835 None] Create group completed successfully. Jun 26 22:11:18 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837" returned: 0 in 0.833s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:18 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 Jun 26 22:11:18 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:18 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9" returned: 0 in 0.745s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:18 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9 Jun 26 22:11:18 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6e13128a-eeeb-4aa1-84ed-32f45fe3506e tempest-GroupsTest-623370835 None] Group tempest-Group2-71208890: creating Jun 26 22:11:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6e13128a-eeeb-4aa1-84ed-32f45fe3506e tempest-GroupsTest-623370835 None] Group tempest-Group2-71208890: created successfully Jun 26 22:11:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6e13128a-eeeb-4aa1-84ed-32f45fe3506e tempest-GroupsTest-623370835 None] Create group completed successfully. Jun 26 22:11:19 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837.43120b91-b061-4928-93d0-8385129879e9" returned: 0 in 0.678s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-43120b91-b061-4928-93d0-8385129879e9" released by "_delete_snapshot" :: held 3.347s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-066ded28-9e71-4667-b2d0-586a9e282837" released by "delete_snapshot" :: held 3.378s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Created reservations ['0b139c39-38d3-460a-ac46-41fb65d51dda', 'e39c91e3-e21d-45c4-89cc-07dd9f618c2b', 'bb0ac6e2-a48d-4998-be51-9fae658455ac', 'e38becc8-89f8-4dd9-9446-db07e614d3a4'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Delete snapshot completed successfully. Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-43120b91-b061-4928-93d0-8385129879e9-delete_snapshot" released by "delete_snapshot" :: held 3.571s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Snapshots deleted, issuing volume delete {{(pid=93616) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-066ded28-9e71-4667-b2d0-586a9e282837" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-066ded28-9e71-4667-b2d0-586a9e282837" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5faa97a0-06bb-4d3d-a427-0d4078190484]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:19 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 Jun 26 22:11:19 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:20 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837" returned: 0 in 1.109s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:21 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837 Jun 26 22:11:21 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Flow 'volume_create_manager' (a20a575b-9b1d-4659-8795-7ce4f5b5f72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce4d0a-fe72-445c-9ecf-b345ed342bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ce4d0a-fe72-445c-9ecf-b345ed342bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839237145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f392961d-44f5-4184-a182-e4a5d2ac3fab,host='devstack@QuobyteHD#QuobyteHD',id=8babc236-8e0e-49e2-b6e3-6001aceea0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02e704f029c4e988b0de6b3b6be24fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:21Z,use_quota=True,user_id='25716e5070ed490980c696bcb4e6b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4025b4e8-94e4-4bdf-b912-cdfef0dafeb7),volume_type_id=4025b4e8-94e4-4bdf-b912-cdfef0dafeb7)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17461840-10ae-49fa-be67-410facae1362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17461840-10ae-49fa-be67-410facae1362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7028fa-aebe-4c28-ae6f-12944034e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7028fa-aebe-4c28-ae6f-12944034e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8babc236-8e0e-49e2-b6e3-6001aceea0f7', 'volume_name': 'volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3987f338-29c6-4044-8076-4108055b9c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3987f338-29c6-4044-8076-4108055b9c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3b4fe4-8ad8-4ba9-958e-22aef536345f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:21 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Volume 8babc236-8e0e-49e2-b6e3-6001aceea0f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7', 'volume_size': 1} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f392961d-44f5-4184-a182-e4a5d2ac3fab,created_at=2026-06-26T20:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-839237145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f392961d-44f5-4184-a182-e4a5d2ac3fab,host='devstack@QuobyteHD#QuobyteHD',id=8babc236-8e0e-49e2-b6e3-6001aceea0f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02e704f029c4e988b0de6b3b6be24fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:21Z,use_quota=True,user_id='25716e5070ed490980c696bcb4e6b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4025b4e8-94e4-4bdf-b912-cdfef0dafeb7),volume_type_id=4025b4e8-94e4-4bdf-b912-cdfef0dafeb7)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Creating volume 8babc236-8e0e-49e2-b6e3-6001aceea0f7 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:11:21 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:11:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:21 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 1073741824 Jun 26 22:11:21 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:22 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-066ded28-9e71-4667-b2d0-586a9e282837" returned: 0 in 1.227s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-066ded28-9e71-4667-b2d0-586a9e282837" released by "delete_volume" :: held 2.409s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Created reservations ['fdbaecb9-3c1e-4b4e-9f14-f9a607db4140', '53c69526-266d-477c-8a8e-31300217fe2e', '5c182dd4-4144-47c1-a792-1793e02ec062', 'decce0b0-d79d-4025-834d-8ed068bca648'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:22 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:22 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:22 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 1073741824" returned: 0 in 1.111s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:22 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 Jun 26 22:11:22 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:23 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.053s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Deleted volume successfully. Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-5b2e1512-ebcc-4d14-aab3-16a61610cea6-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-5b2e1512-ebcc-4d14-aab3-16a61610cea6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-613269af-7480-490b-8fc7-c4a578ca26cf tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-066ded28-9e71-4667-b2d0-586a9e282837-delete_volume" released by "delete_volume" :: held 7.335s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "cinder-quobyte-5b2e1512-ebcc-4d14-aab3-16a61610cea6" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-5b2e1512-ebcc-4d14-aab3-16a61610cea6" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c5a217-7e37-47ee-a7c1-c134739dbc2b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:23 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 Jun 26 22:11:23 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:23 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7" returned: 0 in 1.222s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] <== create_volume: return (2420ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.426s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec3b4fe4-8ad8-4ba9-958e-22aef536345f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6a1a08-d98b-4963-a06e-bf9e91950a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Volume volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 (8babc236-8e0e-49e2-b6e3-6001aceea0f7): created successfully Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6a1a08-d98b-4963-a06e-bf9e91950a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Flow 'volume_create_manager' (a20a575b-9b1d-4659-8795-7ce4f5b5f72b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b27a5f97-5971-4e21-a846-ac29f3ba1e0e tempest-GroupsTest-623370835 None] Created volume successfully. Jun 26 22:11:24 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6" returned: 0 in 1.107s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:24 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6 Jun 26 22:11:24 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6577ac72-4ab0-4a54-aca8-44a3335e8048 tempest-VolumesActionsTest-1632732044 None] Acquiring lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec" by "attach_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6577ac72-4ab0-4a54-aca8-44a3335e8048 tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec" acquired by "attach_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6577ac72-4ab0-4a54-aca8-44a3335e8048 tempest-VolumesActionsTest-1632732044 None] Attaching volume 00c6ea80-1393-4fd3-930f-06a610ae7dec to instance fc5ffe45-18b7-406e-bf9d-f771a7de9d1b at mountpoint /dev/vdb on host None. Jun 26 22:11:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6577ac72-4ab0-4a54-aca8-44a3335e8048 tempest-VolumesActionsTest-1632732044 None] Attach volume completed successfully. Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Acquiring lock "cinder-quobyte-8babc236-8e0e-49e2-b6e3-6001aceea0f7" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6577ac72-4ab0-4a54-aca8-44a3335e8048 tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec" released by "attach_volume" :: held 0.146s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Lock "cinder-quobyte-8babc236-8e0e-49e2-b6e3-6001aceea0f7" acquired by "delete_volume" :: waited 0.036s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a653b7a5-bdf5-44ca-a87d-13ec796dc9d8]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:25 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 Jun 26 22:11:25 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ccb17882-10be-427f-8fee-fea0f4063014 tempest-VolumesActionsTest-1632732044 None] Acquiring lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-detach_volume" by "detach_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:25 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5b2e1512-ebcc-4d14-aab3-16a61610cea6" returned: 0 in 1.002s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ccb17882-10be-427f-8fee-fea0f4063014 tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ccb17882-10be-427f-8fee-fea0f4063014 tempest-VolumesActionsTest-1632732044 None] Detaching volume 00c6ea80-1393-4fd3-930f-06a610ae7dec from instance fc5ffe45-18b7-406e-bf9d-f771a7de9d1b. Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-quobyte-5b2e1512-ebcc-4d14-aab3-16a61610cea6" released by "delete_volume" :: held 2.202s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ccb17882-10be-427f-8fee-fea0f4063014 tempest-VolumesActionsTest-1632732044 None] Detach volume completed successfully. Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ccb17882-10be-427f-8fee-fea0f4063014 tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-detach_volume" released by "detach_volume" :: held 0.129s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Created reservations ['e881ed51-9409-4eff-9caf-9732a5737ee0', '21354169-8717-42e9-b9f6-8bd87da3d98a', '4a14914e-e346-4192-9b90-47b7fb4a7e89', 'dff1d17f-3786-4d29-ba64-9d3a52a94a49'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:25 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:25 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:26 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7" returned: 0 in 1.120s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:26 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7 Jun 26 22:11:26 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:26 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.948s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:26 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:26 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Deleted volume successfully. Jun 26 22:11:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-56afb4f0-99df-47fb-9c6e-1711d2132e85 tempest-VolumesDeleteCascade-958686381 None] Lock "cinder-5b2e1512-ebcc-4d14-aab3-16a61610cea6-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8babc236-8e0e-49e2-b6e3-6001aceea0f7" returned: 0 in 1.022s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:27 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Lock "cinder-quobyte-8babc236-8e0e-49e2-b6e3-6001aceea0f7" released by "delete_volume" :: held 2.254s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Created reservations ['f7d556ad-d157-4302-99ec-02c4f435ea96'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:27 devstack cinder-volume[93616]: WARNING cinder.quota [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1497668213 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1497668213, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:11:27 devstack cinder-volume[93616]: WARNING cinder.quota [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1497668213 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1497668213, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Created reservations ['027fab9d-5d6d-4430-8b9f-136ac62947a2', '7627a50a-5f1e-4978-852e-30fd8f89b23e', '36c619a4-3e51-44e7-a093-71b80edb24dd', '5aabcfde-39e4-4c61-9ff1-b53a458e6714'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:27 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:27 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:28 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-3f65413a-6444-4fd8-98d7-84919ff381c9 req-43ef962c-fa71-4e8f-bb81-2c52bf5ecd5e tempest-TestStampPattern-1819556658 None] Terminate volume connection completed successfully. Jun 26 22:11:28 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-3f65413a-6444-4fd8-98d7-84919ff381c9 req-43ef962c-fa71-4e8f-bb81-2c52bf5ecd5e tempest-TestStampPattern-1819556658 None] Deleting attachment d3336ef1-5f56-41b0-b582-ab3bed7dac4e. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Created reservations ['b6e8f574-5a2d-4c9b-8933-69c64269f754'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:29 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.436s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5dec6aa0-9490-4db1-b2d4-bd355645ebef tempest-GroupsTest-623370835 None] Delete group completed successfully. Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:29 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:29 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Creating offline snapshot 5764b4af-59cb-4090-ad2d-62c35ff5dd4a of volume 41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:11:30 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ecd92b-2a83-467e-85ab-0abe4e82d44f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:30 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.064s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:30 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:30 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c72640fa-00fb-4e6f-b2e8-0dc6aa8f6d16 tempest-GroupsTest-623370835 None] Delete group completed successfully. Jun 26 22:11:30 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:11:30 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-51869f64-fb8d-4560-bd9a-9b9546eca27b tempest-GroupsTest-623370835 None] Group tempest-GroupsTest-Group-1228918866: creating Jun 26 22:11:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-51869f64-fb8d-4560-bd9a-9b9546eca27b tempest-GroupsTest-623370835 None] Group tempest-GroupsTest-Group-1228918866: created successfully Jun 26 22:11:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-51869f64-fb8d-4560-bd9a-9b9546eca27b tempest-GroupsTest-623370835 None] Create group completed successfully. Jun 26 22:11:31 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 1.193s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:31 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a 1G Jun 26 22:11:31 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:32 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a 1G" returned: 0 in 0.886s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:32 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a Jun 26 22:11:32 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Flow 'volume_create_manager' (d4dc4f6a-c322-4add-9d91-dc2cd868ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a7d5e4-a3f6-400c-9747-0f00ac64daed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30a7d5e4-a3f6-400c-9747-0f00ac64daed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-676118324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0e72fe5-e12b-491f-a64b-aba2f2b4aa68,host='devstack@QuobyteHD#QuobyteHD',id=b6985f1f-6bf6-4340-b554-e33be5e0e414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02e704f029c4e988b0de6b3b6be24fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:33Z,use_quota=True,user_id='25716e5070ed490980c696bcb4e6b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7),volume_type_id=ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80a97f5-a409-4fdf-86b4-c75090fcf048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a80a97f5-a409-4fdf-86b4-c75090fcf048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d4c437-6978-4f02-98f0-c78cb7b67980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9d4c437-6978-4f02-98f0-c78cb7b67980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6985f1f-6bf6-4340-b554-e33be5e0e414', 'volume_name': 'volume-b6985f1f-6bf6-4340-b554-e33be5e0e414', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4743359f-0080-4d53-af54-6b1de28bac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4743359f-0080-4d53-af54-6b1de28bac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5b802e-4b20-47e6-8f45-5975f72a39cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Volume b6985f1f-6bf6-4340-b554-e33be5e0e414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6985f1f-6bf6-4340-b554-e33be5e0e414', 'volume_size': 1} Jun 26 22:11:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:33 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a" returned: 0 in 0.869s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:33 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a is being set with open permissions: ugo+rw Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:33 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a Jun 26 22:11:33 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Flow 'volume_create_manager' (1d9fd3b9-4b94-4571-8fdb-185a6a179127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1791cb-1b0d-45e7-b9eb-22e05482dc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:33 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed1791cb-1b0d-45e7-b9eb-22e05482dc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1022286639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8741193f-9152-455f-a79a-ad739a8d3bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c42404c85f4082ae8bb91833746d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:34Z,use_quota=True,user_id='12c6151f470d44f8833547898476e4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2041f3-de61-4389-8c24-b3992d0b9695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2041f3-de61-4389-8c24-b3992d0b9695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12faa789-e5f3-4952-9573-9628e590d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12faa789-e5f3-4952-9573-9628e590d947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8741193f-9152-455f-a79a-ad739a8d3bee', 'volume_name': 'volume-8741193f-9152-455f-a79a-ad739a8d3bee', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e8e12e-12ae-40db-83cf-779c2090e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40e8e12e-12ae-40db-83cf-779c2090e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477966e9-64f0-4ce2-a777-ecf6e4586261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:34 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Volume 8741193f-9152-455f-a79a-ad739a8d3bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8741193f-9152-455f-a79a-ad739a8d3bee', 'volume_size': 1} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a" returned: 0 in 0.723s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:34 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.info Jun 26 22:11:34 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:34 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.info" returned: 0 in 0.620s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:34 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.info is being set with open permissions: ugo+rw Jun 26 22:11:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:34 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.info Jun 26 22:11:34 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:35 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.info" returned: 0 in 0.670s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.094s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.430s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b0e72fe5-e12b-491f-a64b-aba2f2b4aa68,created_at=2026-06-26T20:11:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-676118324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0e72fe5-e12b-491f-a64b-aba2f2b4aa68,host='devstack@QuobyteHD#QuobyteHD',id=b6985f1f-6bf6-4340-b554-e33be5e0e414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02e704f029c4e988b0de6b3b6be24fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:33Z,use_quota=True,user_id='25716e5070ed490980c696bcb4e6b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7),volume_type_id=ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Creating volume b6985f1f-6bf6-4340-b554-e33be5e0e414 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:11:35 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:11:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:35 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 1073741824 Jun 26 22:11:35 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-787b04e9-c414-4cc3-96f7-9852951c45dc tempest-TestStampPattern-1819556658 None] Create snapshot completed successfully Jun 26 22:11:36 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 1073741824" returned: 0 in 0.912s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:36 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 Jun 26 22:11:36 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:37 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414" returned: 0 in 0.672s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.985s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1022286639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8741193f-9152-455f-a79a-ad739a8d3bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c42404c85f4082ae8bb91833746d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:34Z,use_quota=True,user_id='12c6151f470d44f8833547898476e4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Creating volume 8741193f-9152-455f-a79a-ad739a8d3bee {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:11:37 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:37 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee 1073741824 Jun 26 22:11:37 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b5b802e-4b20-47e6-8f45-5975f72a39cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6985f1f-6bf6-4340-b554-e33be5e0e414', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f2d492-2cc6-47ef-8210-398b2dc4c146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:37 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Volume volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 (b6985f1f-6bf6-4340-b554-e33be5e0e414): created successfully Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f2d492-2cc6-47ef-8210-398b2dc4c146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Flow 'volume_create_manager' (d4dc4f6a-c322-4add-9d91-dc2cd868ce23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:37 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d4e8a76d-74e1-4f93-86da-b8af1b738eb4 tempest-GroupsTest-623370835 None] Created volume successfully. Jun 26 22:11:37 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee 1073741824" returned: 0 in 0.857s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:37 devstack sudo[106974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee Jun 26 22:11:37 devstack sudo[106974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Flow 'volume_create_manager' (e4980a30-599f-44cf-8c3c-84084a6a55f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad270f06-6df3-4463-8633-f8c6edc9f4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad270f06-6df3-4463-8633-f8c6edc9f4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-882893044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0e72fe5-e12b-491f-a64b-aba2f2b4aa68,host='devstack@QuobyteHD#QuobyteHD',id=aed82810-afa0-4f7a-aa50-1605431912b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02e704f029c4e988b0de6b3b6be24fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:38Z,use_quota=True,user_id='25716e5070ed490980c696bcb4e6b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7),volume_type_id=ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c62a09-b6c9-4445-a8e0-37f06ba98ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c62a09-b6c9-4445-a8e0-37f06ba98ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b25474-5160-4b56-8bc2-c61bf10a5c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08b25474-5160-4b56-8bc2-c61bf10a5c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed82810-afa0-4f7a-aa50-1605431912b7', 'volume_name': 'volume-aed82810-afa0-4f7a-aa50-1605431912b7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d75c84-ea20-4372-88b3-6d429ed9a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75d75c84-ea20-4372-88b3-6d429ed9a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3c0a1f-5c63-4cdc-a142-4dac0e729a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Volume aed82810-afa0-4f7a-aa50-1605431912b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed82810-afa0-4f7a-aa50-1605431912b7', 'volume_size': 1} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:38 devstack sudo[106974]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee" returned: 0 in 0.686s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.955s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477966e9-64f0-4ce2-a777-ecf6e4586261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8741193f-9152-455f-a79a-ad739a8d3bee', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7d96e8-da98-42f5-b0e5-0618396a3b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e859858-413b-43aa-a23c-c822bcb4cbc1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Volume volume-8741193f-9152-455f-a79a-ad739a8d3bee (8741193f-9152-455f-a79a-ad739a8d3bee): created successfully Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec7d96e8-da98-42f5-b0e5-0618396a3b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Flow 'volume_create_manager' (1d9fd3b9-4b94-4571-8fdb-185a6a179127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7c70901d-1821-4522-a456-93c940d793ef tempest-VolumesTransfersV355Test-1786397482 None] Created volume successfully. Jun 26 22:11:38 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:11:38 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:39 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.765s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:39 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe31ebf8-aa24-43e4-8292-43a781fc8562]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:39 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:11:39 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e50f5de4-e401-4c70-b309-45275d528b38 tempest-VolumesTransfersV355Test-1594417648 None] Transfer volume completed successfully. Jun 26 22:11:40 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.796s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.a07fd90c-d498-43a0-91c8-0f248c172ed3gcysvd4l.img {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:40 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.a07fd90c-d498-43a0-91c8-0f248c172ed3gcysvd4l.img Jun 26 22:11:40 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Acquiring lock "cinder-8741193f-9152-455f-a79a-ad739a8d3bee-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-8741193f-9152-455f-a79a-ad739a8d3bee-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Acquiring lock "cinder-quobyte-8741193f-9152-455f-a79a-ad739a8d3bee" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:11:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-quobyte-8741193f-9152-455f-a79a-ad739a8d3bee" acquired by "delete_volume" :: waited 0.033s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:11:41 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89a67ce-04ed-48ed-964d-39193a301a17]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:41 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee Jun 26 22:11:41 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:43 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee" returned: 0 in 2.305s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:43 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee Jun 26 22:11:43 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:45 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8741193f-9152-455f-a79a-ad739a8d3bee" returned: 0 in 1.783s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-quobyte-8741193f-9152-455f-a79a-ad739a8d3bee" released by "delete_volume" :: held 4.174s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=101,cinder:INSERT=35,cinder:UPDATE=118,cinder:DELETE=11 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Created reservations ['fd4fe596-e376-4ab9-8798-384189aaea57', '5af38a84-3b1e-4f96-af39-43d321e56bdd', '74c35ba1-76de-4307-bafa-76af5087d001', '95228254-a598-48f9-8970-0fa464119aaf'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:11:45 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.a07fd90c-d498-43a0-91c8-0f248c172ed3gcysvd4l.img" returned: 0 in 5.185s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f70119-65de-499f-819b-79ce395830d8]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:45 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:45 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:45 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:11:45 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:46 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.683s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Deleted volume successfully. Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c2f8478a-33d1-4ae9-8d1b-967e2d041844 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-8741193f-9152-455f-a79a-ad739a8d3bee-delete_volume" released by "delete_volume" :: held 5.198s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:11:46 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:11:46 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Flow 'volume_create_manager' (6d0c5310-9876-496d-bcb1-95ccb3e46d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23264df-0b0c-487d-9d87-6c9aad4c9bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d23264df-0b0c-487d-9d87-6c9aad4c9bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-145018079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41284617-38d6-4ca6-bfb0-6fc3d3980793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c42404c85f4082ae8bb91833746d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:46Z,use_quota=True,user_id='12c6151f470d44f8833547898476e4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42edde4-87db-4863-9278-8f67b35fe25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42edde4-87db-4863-9278-8f67b35fe25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10ce7da-dbc4-4ea9-98f7-628e2966ecd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d10ce7da-dbc4-4ea9-98f7-628e2966ecd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41284617-38d6-4ca6-bfb0-6fc3d3980793', 'volume_name': 'volume-41284617-38d6-4ca6-bfb0-6fc3d3980793', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a15d78-9a9e-4924-b994-0f0b4e292a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:46 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a15d78-9a9e-4924-b994-0f0b4e292a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94603e8e-e6ff-49d8-a865-b52f49c1ab3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:46 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Volume 41284617-38d6-4ca6-bfb0-6fc3d3980793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41284617-38d6-4ca6-bfb0-6fc3d3980793', 'volume_size': 1} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 1.149s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec, size 1024.00 MB, duration 5.19 sec, destination /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.a07fd90c-d498-43a0-91c8-0f248c172ed3gcysvd4l.img {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:11:46 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Converted 1024.00 MB image at 197.44 MB/s Jun 26 22:11:46 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] a07fd90c-d498-43a0-91c8-0f248c172ed3 was raw, no need to convert to raw {{(pid=93616) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 26 22:11:47 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jun 26 22:11:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.746s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:11:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:11:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:11:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:11:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Flow 'volume_create_manager' (73b1c903-a288-41f8-b18c-ae9efdd51727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1c7b8a-24ac-4db6-8a47-818f52037362) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a1c7b8a-24ac-4db6-8a47-818f52037362) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1722503816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65a24d4-9084-4535-984c-2feb64588adf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3dd894c1e8b407992810da58d488a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5764b4af-59cb-4090-ad2d-62c35ff5dd4a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:49Z,use_quota=True,user_id='f7b610e3df814d05a57d4322d90fefe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed891329-4a9f-4313-a850-d65609a05eda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed891329-4a9f-4313-a850-d65609a05eda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be5b068-1687-47cc-be23-e81eae52043c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be5b068-1687-47cc-be23-e81eae52043c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e65a24d4-9084-4535-984c-2feb64588adf', 'volume_name': 'volume-e65a24d4-9084-4535-984c-2feb64588adf', 'volume_size': 1, 'snapshot_id': '5764b4af-59cb-4090-ad2d-62c35ff5dd4a'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309dceca-209a-4a4c-bebf-97586605d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309dceca-209a-4a4c-bebf-97586605d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6a6557-857d-41e7-b160-c61327e4352c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:11:48 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Volume e65a24d4-9084-4535-984c-2feb64588adf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e65a24d4-9084-4535-984c-2feb64588adf', 'volume_size': 1, 'snapshot_id': '5764b4af-59cb-4090-ad2d-62c35ff5dd4a'} Jun 26 22:11:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:11:58 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:DELETE=3,cinder:SELECT=83,cinder:INSERT=14,cinder:UPDATE=78 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:11:58 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:INSERT=1,cinder:UPDATE=7,cinder:SELECT=6,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.910s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Uploaded volume to glance image-id: a07fd90c-d498-43a0-91c8-0f248c172ed3. {{(pid=93616) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 31.155s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b0e72fe5-e12b-491f-a64b-aba2f2b4aa68,created_at=2026-06-26T20:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-882893044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0e72fe5-e12b-491f-a64b-aba2f2b4aa68,host='devstack@QuobyteHD#QuobyteHD',id=aed82810-afa0-4f7a-aa50-1605431912b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f02e704f029c4e988b0de6b3b6be24fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:38Z,use_quota=True,user_id='25716e5070ed490980c696bcb4e6b005',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7),volume_type_id=ebe7f4b0-73b0-4442-9b9e-035ee4ef62c7)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Creating volume aed82810-afa0-4f7a-aa50-1605431912b7 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:12:09 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:12:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-65424052-f3f7-4586-b38a-357dfff4f230 tempest-VolumesActionsTest-1632732044 None] Copy volume to image completed successfully. Jun 26 22:12:09 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 1073741824 Jun 26 22:12:09 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:10 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 1073741824" returned: 0 in 0.951s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:10 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 Jun 26 22:12:10 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:11 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7" returned: 0 in 0.651s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.625s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-145018079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41284617-38d6-4ca6-bfb0-6fc3d3980793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68c42404c85f4082ae8bb91833746d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:11:46Z,use_quota=True,user_id='12c6151f470d44f8833547898476e4eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Creating volume 41284617-38d6-4ca6-bfb0-6fc3d3980793 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:12:11 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:11 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 1073741824 Jun 26 22:12:11 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3c0a1f-5c63-4cdc-a142-4dac0e729a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed82810-afa0-4f7a-aa50-1605431912b7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e9a76f-9836-46e6-b6c5-90c8edccc2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:11 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Volume volume-aed82810-afa0-4f7a-aa50-1605431912b7 (aed82810-afa0-4f7a-aa50-1605431912b7): created successfully Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17e9a76f-9836-46e6-b6c5-90c8edccc2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Flow 'volume_create_manager' (e4980a30-599f-44cf-8c3c-84084a6a55f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8dfe6d0a-f51e-48d5-a0b1-b1a8a3a3bd44 tempest-GroupsTest-623370835 None] Created volume successfully. Jun 26 22:12:11 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 1073741824" returned: 0 in 0.802s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:12 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 Jun 26 22:12:12 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-94211f78-93c2-4749-bc43-d9ea6e446877 tempest-GroupsTest-623370835 None] Update group completed successfully. Jun 26 22:12:12 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793" returned: 0 in 0.676s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 23.794s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-quobyte-5764b4af-59cb-4090-ad2d-62c35ff5dd4a-e65a24d4-9084-4535-984c-2feb64588adf" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-5764b4af-59cb-4090-ad2d-62c35ff5dd4a-e65a24d4-9084-4535-984c-2feb64588adf" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Creating volume e65a24d4-9084-4535-984c-2feb64588adf from snapshot 5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-quobyte-e65a24d4-9084-4535-984c-2feb64588adf" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94603e8e-e6ff-49d8-a865-b52f49c1ab3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41284617-38d6-4ca6-bfb0-6fc3d3980793', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3e9f46-a3be-44e2-94d4-7a8a4f98f0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-e65a24d4-9084-4535-984c-2feb64588adf" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] snapshot: 5764b4af-59cb-4090-ad2d-62c35ff5dd4a, volume: e65a24d4-9084-4535-984c-2feb64588adf, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:12:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Volume volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 (41284617-38d6-4ca6-bfb0-6fc3d3980793): created successfully Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e3e9f46-a3be-44e2-94d4-7a8a4f98f0d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Flow 'volume_create_manager' (6d0c5310-9876-496d-bcb1-95ccb3e46d1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-574c3ada-8747-4e62-9b24-5063ebf38fa6 tempest-VolumesTransfersV355Test-1786397482 None] Created volume successfully. Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea32363-81cd-479a-bf29-22f0455bee1a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:12 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a Jun 26 22:12:12 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-19bc186d-6f2f-44d2-8cb4-463ffa0a9e3d tempest-GroupsTest-623370835 None] Update group completed successfully. Jun 26 22:12:13 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a" returned: 0 in 0.863s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:12:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:12:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:12:13 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8ea522-c186-4d3c-a0ab-2fb076942926]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:13 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:12:13 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Acquiring lock "cinder-41284617-38d6-4ca6-bfb0-6fc3d3980793-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-41284617-38d6-4ca6-bfb0-6fc3d3980793-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Acquiring lock "cinder-quobyte-41284617-38d6-4ca6-bfb0-6fc3d3980793" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-quobyte-41284617-38d6-4ca6-bfb0-6fc3d3980793" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b6da51-1bb4-46a0-8cc4-750839b0e7d4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:14 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 Jun 26 22:12:14 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:14 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 0.834s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:12:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:14 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf Jun 26 22:12:14 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:15 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793" returned: 0 in 1.087s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:15 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793 Jun 26 22:12:15 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Acquiring lock "cinder-quobyte-aed82810-afa0-4f7a-aa50-1605431912b7" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Lock "cinder-quobyte-aed82810-afa0-4f7a-aa50-1605431912b7" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39650e8-f948-4073-aa84-6ab6ee0d7135]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:15 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 Jun 26 22:12:15 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:16 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41284617-38d6-4ca6-bfb0-6fc3d3980793" returned: 0 in 1.611s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-quobyte-41284617-38d6-4ca6-bfb0-6fc3d3980793" released by "delete_volume" :: held 2.817s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Created reservations ['a4e9fbf6-8d5b-47ba-b2b5-7e0ab9c5452d', '15d5b68b-b93e-40d0-a979-821fb363fb7c', 'fd26ae43-2018-4742-8481-fc10dc34563f', '1580605a-81b0-4276-9386-6d76cc29d402'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:12:17 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7" returned: 0 in 1.887s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:17 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:12:17 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:17 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7 Jun 26 22:12:17 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:19 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aed82810-afa0-4f7a-aa50-1605431912b7" returned: 0 in 1.565s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Lock "cinder-quobyte-aed82810-afa0-4f7a-aa50-1605431912b7" released by "delete_volume" :: held 3.557s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Acquiring lock "cinder-quobyte-b6985f1f-6bf6-4340-b554-e33be5e0e414" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Lock "cinder-quobyte-b6985f1f-6bf6-4340-b554-e33be5e0e414" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:19 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.720s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:12:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Deleted volume successfully. Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[65aded63-5395-4a40-8e90-03f48d94f17d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-058820c7-f69f-421f-b445-32b8b696ec08 tempest-VolumesTransfersV355Test-1138143438 None] Lock "cinder-41284617-38d6-4ca6-bfb0-6fc3d3980793-delete_volume" released by "delete_volume" :: held 5.281s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:19 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 Jun 26 22:12:19 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:21 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414" returned: 0 in 1.858s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:21 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414 Jun 26 22:12:21 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:21 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf" returned: 0 in 6.648s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[16812237-1bf9-459a-b481-321dcbe063c1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:21 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:12:21 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b6985f1f-6bf6-4340-b554-e33be5e0e414" returned: 0 in 0.813s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:21 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Lock "cinder-quobyte-b6985f1f-6bf6-4340-b554-e33be5e0e414" released by "delete_volume" :: held 2.788s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Created reservations ['5f35051e-98d7-4217-b214-f066dbab5c7f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:12:22 devstack cinder-volume[93616]: WARNING cinder.quota [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-228833918 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-228833918, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:12:22 devstack cinder-volume[93616]: WARNING cinder.quota [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-228833918 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-228833918, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Created reservations ['c2cec9c4-ae12-4a83-b903-eb3c6d264397', '652bdcd6-c0c1-4eea-b11b-1ed45d1a96e2', '274f3d9a-99c4-4a01-a04a-a01c90ab205b', '95bbaf98-034f-4a73-aa98-c8887620b1e3'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Created reservations ['764239fd-1842-4388-a415-65d371a3b10f', 'f9c86166-e86d-49bc-aac3-9357690e871f', 'b5d61a1f-80c5-4df6-8f01-25720510dde3', '1d41e7d7-50d8-4244-b274-d310f4869289'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:12:22 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 1.026s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:12:22 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Converted 1024.00 MB image at 154.01 MB/s Jun 26 22:12:22 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf is being set with open permissions: ugo+rw Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:22 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf Jun 26 22:12:22 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:22 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:12:22 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:23 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf" returned: 0 in 0.830s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-e65a24d4-9084-4535-984c-2feb64588adf" released by "_copy_volume_from_snapshot" :: held 10.349s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-5764b4af-59cb-4090-ad2d-62c35ff5dd4a-e65a24d4-9084-4535-984c-2feb64588adf" released by "_create_volume_from_snapshot" :: held 10.410s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.432s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 12.561s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f378d5c-bf8f-4147-98bb-546b1eb4bbc6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6a6557-857d-41e7-b160-c61327e4352c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65a24d4-9084-4535-984c-2feb64588adf', 'volume_size': 1, 'snapshot_id': '5764b4af-59cb-4090-ad2d-62c35ff5dd4a'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f25db6-2961-4d94-a736-1173069d7eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Volume volume-e65a24d4-9084-4535-984c-2feb64588adf (e65a24d4-9084-4535-984c-2feb64588adf): created successfully Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8f25db6-2961-4d94-a736-1173069d7eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Flow 'volume_create_manager' (73b1c903-a288-41f8-b18c-ae9efdd51727) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ca8c671c-3cc5-49f7-a657-10c3c3d8f412 tempest-TestStampPattern-1819556658 None] Created volume successfully. Jun 26 22:12:23 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:12:23 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:23 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.976s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:23 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:12:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cbee32a7-63f2-4e9a-b988-7cbcddc0b018 tempest-GroupsTest-623370835 None] Delete group completed successfully. Jun 26 22:12:24 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.895s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:24 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c5fad2-ac50-4088-b554-d935e5d2c0af]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:24 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:12:24 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:24 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.855s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:25 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img Jun 26 22:12:25 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Flow 'volume_create_manager' (3cf4ca03-3e79-4010-959d-7abbac14330d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7f989f-366a-4169-8317-ad6fcaf4d036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7f989f-366a-4169-8317-ad6fcaf4d036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2127400534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6285f8a6362b43beac616dfbb88ba082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:12:27Z,use_quota=True,user_id='f53a9864e1c34c1eb79bbbce862f47ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0391c85-cf9d-44a8-a6ef-f0438a81a5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0391c85-cf9d-44a8-a6ef-f0438a81a5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba7085-d80e-4c73-86c3-29e18e09eb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba7085-d80e-4c73-86c3-29e18e09eb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59', 'volume_name': 'volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce3b695-6049-4057-a2a9-0b67bea93695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce3b695-6049-4057-a2a9-0b67bea93695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c791296-7b4d-4f42-b010-f296de30de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:27 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Volume 7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59', 'volume_size': 1} Jun 26 22:12:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:30 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img" returned: 0 in 5.539s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:30 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[011c3b5b-02e5-45fc-82a3-c6af27038588]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:30 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:12:30 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a584271f-8f6a-4f7d-89f0-53ee6a9c3e71 tempest-GroupsV314Test-1688756435 None] Group tempest-GroupsV314Test-Group-121787896: creating Jun 26 22:12:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a584271f-8f6a-4f7d-89f0-53ee6a9c3e71 tempest-GroupsV314Test-1688756435 None] Group tempest-GroupsV314Test-Group-121787896: created successfully Jun 26 22:12:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a584271f-8f6a-4f7d-89f0-53ee6a9c3e71 tempest-GroupsV314Test-1688756435 None] Create group completed successfully. Jun 26 22:12:31 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.950s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:31 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec, size 1024.00 MB, duration 5.54 sec, destination /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:12:31 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Converted 1024.00 MB image at 184.84 MB/s Jun 26 22:12:31 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] 851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a28 was raw, converting to qcow2 {{(pid=93616) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 26 22:12:31 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da3638b-6698-418d-9c46-71adad9c1e56]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:31 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img Jun 26 22:12:31 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:32 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img" returned: 0 in 0.715s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:32 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img Jun 26 22:12:32 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Flow 'volume_create_manager' (bfbd6153-c9d2-4ca2-8806-4d6e2da9ff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0ff092-de9c-489d-be7c-666ade8dcbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f0ff092-de9c-489d-be7c-666ade8dcbcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304895767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4dd1d97f-4271-41b1-a05a-ad72c9306349,host='devstack@QuobyteHD#QuobyteHD',id=eda5dc22-75f5-409f-be7b-9d125d0e2dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ebce76104240468d67579297a59a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:12:33Z,use_quota=True,user_id='85dc14fb3e7447d7872f63af6ac4a087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afe3ff7b-b38f-4a6d-8df9-e37ac1c368b7),volume_type_id=afe3ff7b-b38f-4a6d-8df9-e37ac1c368b7)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd053fb3-e35e-4590-a4a5-bc21dd76c96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd053fb3-e35e-4590-a4a5-bc21dd76c96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2248e842-e5a2-4c93-b19e-9eee47aa5b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2248e842-e5a2-4c93-b19e-9eee47aa5b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eda5dc22-75f5-409f-be7b-9d125d0e2dbd', 'volume_name': 'volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b51a27e-6cfd-48aa-a683-5633cc9b8f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b51a27e-6cfd-48aa-a683-5633cc9b8f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab6086-49a6-48d9-95b7-0b319a072869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Volume eda5dc22-75f5-409f-be7b-9d125d0e2dbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd', 'volume_size': 1} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:32 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img" returned: 1 in 0.714s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:12:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img /opt/stack/data/cinder/conversion/vol_upload_3frywonk {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:32 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img /opt/stack/data/cinder/conversion/vol_upload_3frywonk Jun 26 22:12:32 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:33 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img /opt/stack/data/cinder/conversion/vol_upload_3frywonk" returned: 0 in 0.623s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:33 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Image conversion details: src /opt/stack/data/cinder/conversion/00c6ea80-1393-4fd3-930f-06a610ae7dec.temp_image.851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a2895lj36z4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_3frywonk {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:12:33 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 26 22:12:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e365029-968f-4e0a-aaa7-6abf75e8a789]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3frywonk {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:33 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3frywonk Jun 26 22:12:33 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:34 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_3frywonk" returned: 0 in 0.696s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.370s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Uploaded volume to glance image-id: 851fdf5a-7cb8-4d7a-8d7c-0c2a4a4b5a28. {{(pid=93616) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2127400534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6285f8a6362b43beac616dfbb88ba082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:12:27Z,use_quota=True,user_id='f53a9864e1c34c1eb79bbbce862f47ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Creating volume 7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:12:35 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:12:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:35 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 1073741824 Jun 26 22:12:35 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c59bb529-d799-46d6-ac80-5f77a5d37bf4 tempest-VolumesActionsTest-1632732044 None] Copy volume to image completed successfully. Jun 26 22:12:36 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 1073741824" returned: 0 in 0.871s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:36 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 Jun 26 22:12:36 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Acquiring lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Acquiring lock "cinder-quobyte-00c6ea80-1393-4fd3-930f-06a610ae7dec" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Lock "cinder-quobyte-00c6ea80-1393-4fd3-930f-06a610ae7dec" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbe7eb0-37be-485a-afb7-7336635d1b20]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:36 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:12:36 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:37 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" returned: 0 in 0.667s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] <== create_volume: return (1579ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.346s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4dd1d97f-4271-41b1-a05a-ad72c9306349,created_at=2026-06-26T20:12:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-304895767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4dd1d97f-4271-41b1-a05a-ad72c9306349,host='devstack@QuobyteHD#QuobyteHD',id=eda5dc22-75f5-409f-be7b-9d125d0e2dbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7ebce76104240468d67579297a59a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:12:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:12:33Z,use_quota=True,user_id='85dc14fb3e7447d7872f63af6ac4a087',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(afe3ff7b-b38f-4a6d-8df9-e37ac1c368b7),volume_type_id=afe3ff7b-b38f-4a6d-8df9-e37ac1c368b7)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Creating volume eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:12:37 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:37 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd 1073741824 Jun 26 22:12:37 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c791296-7b4d-4f42-b010-f296de30de5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e398b724-c6a6-4447-8fa1-c0a0ba96a413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:37 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Volume volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 (7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59): created successfully Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e398b724-c6a6-4447-8fa1-c0a0ba96a413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Flow 'volume_create_manager' (3cf4ca03-3e79-4010-959d-7abbac14330d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:37 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-310875cb-f0a2-44a0-87f3-bbb1a80987e1 tempest-VolumesCloneTest-1069875709 None] Created volume successfully. Jun 26 22:12:37 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.770s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:37 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec Jun 26 22:12:37 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:38 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:38 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd 1073741824" returned: 0 in 0.911s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-00c6ea80-1393-4fd3-930f-06a610ae7dec" returned: 0 in 0.700s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Lock "cinder-quobyte-00c6ea80-1393-4fd3-930f-06a610ae7dec" released by "delete_volume" :: held 1.511s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:38 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd Jun 26 22:12:38 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Created reservations ['8ce4bea6-f62f-4358-be40-534017e5d3ac', '5b86f6b5-f031-4d6b-b19e-cc76962824bd', '63c4d3af-e3b1-4ada-9a87-30e62e1e0244', '0fe8beb4-76bc-4eb3-86eb-2b8960cdfeff'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:38 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:12:38 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Flow 'volume_create_manager' (50df6c0b-4196-4c96-96ca-4c5a21d136bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a84170-ca5c-49f2-9502-a3f075f2da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a84170-ca5c-49f2-9502-a3f075f2da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-641340163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=769805c8-aa47-4e9b-b150-58e8c35d34ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6285f8a6362b43beac616dfbb88ba082',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:12:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59,status='creating',terminated_at=None,updated_at=2026-06-26T20:12:39Z,use_quota=True,user_id='f53a9864e1c34c1eb79bbbce862f47ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fca717-f49a-4c44-b54c-1560e6a3e701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05fca717-f49a-4c44-b54c-1560e6a3e701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c0c40b-9e08-499a-ad4d-23f3633d19e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c0c40b-9e08-499a-ad4d-23f3633d19e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '769805c8-aa47-4e9b-b150-58e8c35d34ab', 'volume_name': 'volume-769805c8-aa47-4e9b-b150-58e8c35d34ab', 'volume_size': 2, 'source_volid': '7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59', 'source_volstatus': 'available'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1bee77-7596-4c75-bb77-a551947698cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1bee77-7596-4c75-bb77-a551947698cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0d6938-2fbf-439e-a1af-a32f96c96e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Volume 769805c8-aa47-4e9b-b150-58e8c35d34ab: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-769805c8-aa47-4e9b-b150-58e8c35d34ab', 'volume_size': 2, 'source_volid': '7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59', 'source_volstatus': 'available'} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:38 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" returned: 0 in 0.795s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.115s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:38 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Cloning volume 7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 to volume 769805c8-aa47-4e9b-b150-58e8c35d34ab Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ab6086-49a6-48d9-95b7-0b319a072869) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb29ec7-3d55-4a75-8b1a-03682ea3d165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Volume volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd (eda5dc22-75f5-409f-be7b-9d125d0e2dbd): created successfully Jun 26 22:12:38 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbb29ec7-3d55-4a75-8b1a-03682ea3d165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Flow 'volume_create_manager' (bfbd6153-c9d2-4ca2-8806-4d6e2da9ff9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.732s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:12:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Deleted volume successfully. Jun 26 22:12:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Creating offline snapshot 296282c7-c8ff-459d-adfc-cd767adc48cc of volume 7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:12:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d5dd6c45-bb0a-4811-8152-fe9246ee7991 tempest-GroupsV314Test-1688756435 None] Created volume successfully. Jun 26 22:12:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e5b9eda-897f-44fe-8833-8c294cb4affc tempest-VolumesActionsTest-1632732044 None] Lock "cinder-00c6ea80-1393-4fd3-930f-06a610ae7dec-delete_volume" released by "delete_volume" :: held 2.522s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:39 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0becd9a4-597f-49e2-9d9c-4775219e258e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:39 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 Jun 26 22:12:39 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:39 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" returned: 0 in 0.831s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:39 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc 1G Jun 26 22:12:39 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:40 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc 1G" returned: 0 in 0.971s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:40 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc Jun 26 22:12:40 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc" returned: 0 in 0.961s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:41 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc is being set with open permissions: ugo+rw Jun 26 22:12:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:41 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:41 devstack sudo[107395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc Jun 26 22:12:41 devstack sudo[107395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:42 devstack sudo[107395]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc" returned: 0 in 0.702s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:42 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.info Jun 26 22:12:42 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:43 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.info" returned: 0 in 0.784s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:43 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.info is being set with open permissions: ugo+rw Jun 26 22:12:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:43 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.info Jun 26 22:12:43 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:43 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.info" returned: 0 in 0.689s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "cinder-quobyte-769805c8-aa47-4e9b-b150-58e8c35d34ab" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-769805c8-aa47-4e9b-b150-58e8c35d34ab" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] snapshot: 296282c7-c8ff-459d-adfc-cd767adc48cc, volume: 769805c8-aa47-4e9b-b150-58e8c35d34ab, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4c6820-1fe3-4324-9d81-0490a6f89cb3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:44 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc Jun 26 22:12:44 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:44 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc" returned: 0 in 0.800s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb094580-59f0-43f7-a7f3-67263a7fcab8]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:45 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 Jun 26 22:12:45 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Flow 'volume_create_manager' (654e1404-8f88-4a83-b970-4482b2107b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8277b346-1c6d-441c-b28d-e86179674761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8277b346-1c6d-441c-b28d-e86179674761) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-384633551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c53997-757c-4e08-8623-1996715324a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27539e7251a4de6abc6cb34e274e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:12:45Z,use_quota=True,user_id='84d7a417cd9d416bae10044445ca0af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb26d6a-a59c-4c1e-a6c3-9ac49b093745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb26d6a-a59c-4c1e-a6c3-9ac49b093745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d46926f-8108-4809-8e44-fb19662b0dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d46926f-8108-4809-8e44-fb19662b0dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c53997-757c-4e08-8623-1996715324a0', 'volume_name': 'volume-71c53997-757c-4e08-8623-1996715324a0', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca070123-4319-41b8-8c4e-dc0a429b8a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca070123-4319-41b8-8c4e-dc0a429b8a91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0eb71d-1b9e-495b-bb1b-197765e49538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:45 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Volume 71c53997-757c-4e08-8623-1996715324a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c53997-757c-4e08-8623-1996715324a0', 'volume_size': 1} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:45 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" returned: 0 in 0.782s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:12:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:45 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab Jun 26 22:12:45 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:12:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:46 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:12:46 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:47 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.237s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:12:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:12:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:12:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:12:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-e9e64cbd-91b5-4402-a54b-698d6229b32f req-f1584385-80e9-4db1-bae6-b18f5e431603 tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:50 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab" returned: 0 in 4.757s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:50 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda4d60a-2ffa-40e3-a483-da798e276033]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:50 devstack sudo[107453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 Jun 26 22:12:50 devstack sudo[107453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:51 devstack sudo[107453]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" returned: 0 in 0.966s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:51 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59, size 1024.00 MB, duration 4.76 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:12:51 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Converted 1024.00 MB image at 215.21 MB/s Jun 26 22:12:51 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab is being set with open permissions: ugo+rw Jun 26 22:12:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:51 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab Jun 26 22:12:51 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:52 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab" returned: 0 in 0.648s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-769805c8-aa47-4e9b-b150-58e8c35d34ab" released by "_copy_volume_from_snapshot" :: held 8.056s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "cinder-quobyte-296282c7-c8ff-459d-adfc-cd767adc48cc" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-296282c7-c8ff-459d-adfc-cd767adc48cc" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Deleting offline snapshot 296282c7-c8ff-459d-adfc-cd767adc48cc of volume 7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] snapshot_file for this snap is: volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e977bb-5ea3-4fff-8bd4-14995a2c0438]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:52 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc Jun 26 22:12:52 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:52 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc" returned: 0 in 0.753s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aadb11-cf2e-48f5-85df-cad20e991cd1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:53 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 Jun 26 22:12:53 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:53 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" returned: 0 in 0.776s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:53 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc Jun 26 22:12:53 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:54 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc" returned: 0 in 0.773s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:54 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc Jun 26 22:12:54 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:55 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59.296282c7-c8ff-459d-adfc-cd767adc48cc" returned: 0 in 0.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-296282c7-c8ff-459d-adfc-cd767adc48cc" released by "_delete_snapshot" :: held 3.102s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.365s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 14.327s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:55 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Cloning volume eda5dc22-75f5-409f-be7b-9d125d0e2dbd to volume e145fe89-8853-4230-b7de-b12d2fe4a0a2 Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc0d6938-2fbf-439e-a1af-a32f96c96e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-769805c8-aa47-4e9b-b150-58e8c35d34ab', 'volume_size': 2, 'source_volid': '7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59', 'source_volstatus': 'available'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136cfdf9-fef6-4883-8450-70059a6e3a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:12:55 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Volume volume-769805c8-aa47-4e9b-b150-58e8c35d34ab (769805c8-aa47-4e9b-b150-58e8c35d34ab): created successfully Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136cfdf9-fef6-4883-8450-70059a6e3a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Flow 'volume_create_manager' (50df6c0b-4196-4c96-96ca-4c5a21d136bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Creating offline snapshot ee17e823-ef8e-47cc-b0f6-2ea1b2206600 of volume eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99afb43-a37c-4791-b0f6-7bfb5540ad6b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:55 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5613de36-91fd-47ba-92a8-6c07f0f5e069 tempest-VolumesCloneTest-1069875709 None] Created volume successfully. Jun 26 22:12:55 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd Jun 26 22:12:55 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:56 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" returned: 0 in 0.782s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:56 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 1G Jun 26 22:12:56 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "cinder-769805c8-aa47-4e9b-b150-58e8c35d34ab-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-769805c8-aa47-4e9b-b150-58e8c35d34ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "cinder-quobyte-769805c8-aa47-4e9b-b150-58e8c35d34ab" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-769805c8-aa47-4e9b-b150-58e8c35d34ab" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[92dd3057-bdf5-4d73-bd3f-9500c410fc8b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:56 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab Jun 26 22:12:56 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:56 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 1G" returned: 0 in 0.816s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:56 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 Jun 26 22:12:56 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:57 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:57 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab Jun 26 22:12:57 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:57 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600" returned: 0 in 0.682s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:57 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:12:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:57 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 Jun 26 22:12:57 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:57 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-769805c8-aa47-4e9b-b150-58e8c35d34ab" returned: 0 in 0.642s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-769805c8-aa47-4e9b-b150-58e8c35d34ab" released by "delete_volume" :: held 1.472s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Created reservations ['e34ee239-07fe-444b-8e8f-435f99cb6d23', '7e0d873f-eef5-466b-b12a-506d6e12447e', 'f76794b4-5e43-4a67-b178-62cb728ee564', '50978fcc-2cbb-467b-85f6-33f1c0a3db28'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:58 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:12:58 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:58 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600" returned: 0 in 0.650s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:58 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.info Jun 26 22:12:58 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Acquiring lock "cinder-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Lock "cinder-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:58 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.647s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:12:58 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Deleted volume successfully. Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d8068fbf-8061-47b1-89cd-8f2a88f04358 tempest-VolumesCloneTest-1069875709 None] Lock "cinder-769805c8-aa47-4e9b-b150-58e8c35d34ab-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Acquiring lock "cinder-quobyte-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" acquired by "delete_volume" :: waited 0.013s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a671d4-fb2d-4cc1-af43-c4605ef201bb]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:58 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 Jun 26 22:12:58 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:59 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.info" returned: 0 in 0.685s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:59 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.info is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:59 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.info Jun 26 22:12:59 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:59 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" returned: 0 in 0.776s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:59 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59 Jun 26 22:12:59 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:12:59 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.info" returned: 0 in 0.671s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Acquiring lock "cinder-quobyte-e145fe89-8853-4230-b7de-b12d2fe4a0a2" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-e145fe89-8853-4230-b7de-b12d2fe4a0a2" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] snapshot: ee17e823-ef8e-47cc-b0f6-2ea1b2206600, volume: e145fe89-8853-4230-b7de-b12d2fe4a0a2, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[33207f25-b9f7-432d-a763-d39eb554770a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:12:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:12:59 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 Jun 26 22:12:59 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:00 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" returned: 0 in 0.648s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Lock "cinder-quobyte-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59" released by "delete_volume" :: held 1.472s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Created reservations ['a9fa644c-c501-4dae-a6cc-acd0a0fd6ad0', 'bcf7ddbf-8685-4561-822d-e02baf41c3ab', 'b9e0741d-7eb4-4d7b-8a3e-b4e19d4f65eb', 'fab7d5ae-e82a-42f6-a8d5-06432a1f0ab5'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:00 devstack sudo[107528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:00 devstack sudo[107528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:00 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600" returned: 0 in 0.768s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce460ebe-13fb-478a-9e07-7c232e21054a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:00 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd Jun 26 22:13:00 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:01 devstack sudo[107528]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.677s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:01 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:01 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Deleted volume successfully. Jun 26 22:13:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-191b1b8c-7953-4f1c-8abd-fffb169c476e tempest-VolumesCloneTest-1069875709 None] Lock "cinder-7dd170fc-c2aa-47ab-b36f-07c4a1b9fa59-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:01 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" returned: 0 in 0.751s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:01 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:13:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:01 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 Jun 26 22:13:01 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:06 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2" returned: 0 in 5.008s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:06 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5dde69-f78d-4758-a97a-7eaef71f6103]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:06 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd Jun 26 22:13:06 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:07 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" returned: 0 in 1.001s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:07 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd, size 1024.00 MB, duration 5.01 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:13:07 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Converted 1024.00 MB image at 204.42 MB/s Jun 26 22:13:07 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 is being set with open permissions: ugo+rw: NotImplementedError Jun 26 22:13:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:07 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 Jun 26 22:13:07 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:07 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2" returned: 0 in 0.662s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-e145fe89-8853-4230-b7de-b12d2fe4a0a2" released by "_copy_volume_from_snapshot" :: held 8.284s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Acquiring lock "cinder-quobyte-ee17e823-ef8e-47cc-b0f6-2ea1b2206600" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-ee17e823-ef8e-47cc-b0f6-2ea1b2206600" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Deleting offline snapshot ee17e823-ef8e-47cc-b0f6-2ea1b2206600 of volume eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] snapshot_file for this snap is: volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c3108c-8fb5-4b53-9209-a332cafdf8a7]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:08 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 Jun 26 22:13:08 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Flow 'volume_create_manager' (b91c8051-2740-48a8-9c24-ca01d7f5fe76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959c2225-b541-427a-afbb-50d699f4ca23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:08 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959c2225-b541-427a-afbb-50d699f4ca23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1576399409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2661c7-1dd5-42eb-a65b-e06ac218c00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7842885abc924aa2a6617caf09594383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:09Z,use_quota=True,user_id='5f1e7844b63d49609c87d21dfac17bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6626f68-54de-416e-9204-03a4c10d22a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6626f68-54de-416e-9204-03a4c10d22a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278208f6-99db-43ef-93e7-f7b86484d359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (278208f6-99db-43ef-93e7-f7b86484d359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a2661c7-1dd5-42eb-a65b-e06ac218c00e', 'volume_name': 'volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04c2d8f-1764-476f-bf5b-afd4088e97ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04c2d8f-1764-476f-bf5b-afd4088e97ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116d2ab0-23d2-4802-8e1d-7272feba3d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:08 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e', 'volume_size': 1} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600" returned: 0 in 0.895s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6596b969-751c-4653-826a-3600a74edc6d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:09 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd Jun 26 22:13:09 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:09 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" returned: 0 in 0.732s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:09 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 Jun 26 22:13:09 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:10 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600" returned: 0 in 0.708s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:10 devstack sudo[107613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600 Jun 26 22:13:10 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:11 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd.ee17e823-ef8e-47cc-b0f6-2ea1b2206600" returned: 0 in 0.641s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-ee17e823-ef8e-47cc-b0f6-2ea1b2206600" released by "_delete_snapshot" :: held 3.075s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=76,cinder:SELECT=68,cinder:DELETE=4,cinder:INSERT=16 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=55,cinder:UPDATE=73,cinder:INSERT=18,cinder:DELETE=6 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.962s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.936s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-384633551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c53997-757c-4e08-8623-1996715324a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f27539e7251a4de6abc6cb34e274e3be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:12:45Z,use_quota=True,user_id='84d7a417cd9d416bae10044445ca0af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Creating volume 71c53997-757c-4e08-8623-1996715324a0 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:13:11 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:13:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:11 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 1073741824 Jun 26 22:13:11 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-31ebca0d-2e75-46cb-b7d7-a14b942d4f7b tempest-GroupsV314Test-1688756435 None] Create group from source-group-4dd1d97f-4271-41b1-a05a-ad72c9306349 completed successfully. Jun 26 22:13:12 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 1073741824" returned: 0 in 0.856s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:12 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 Jun 26 22:13:12 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:12 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0" returned: 0 in 0.620s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-e9e64cbd-91b5-4402-a54b-698d6229b32f req-f1584385-80e9-4db1-bae6-b18f5e431603 tempest-TestStampPattern-1819556658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 25.089s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0eb71d-1b9e-495b-bb1b-197765e49538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c53997-757c-4e08-8623-1996715324a0', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3663efdb-8e14-4f4a-9d62-53b61d976c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41f4f5a-02df-467d-b4b4-7e40e58be08d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-e9e64cbd-91b5-4402-a54b-698d6229b32f req-f1584385-80e9-4db1-bae6-b18f5e431603 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Volume volume-71c53997-757c-4e08-8623-1996715324a0 (71c53997-757c-4e08-8623-1996715324a0): created successfully Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3663efdb-8e14-4f4a-9d62-53b61d976c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Flow 'volume_create_manager' (654e1404-8f88-4a83-b970-4482b2107b74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-aaf42a5c-ca5d-4caa-80e4-1ca03207efe7 tempest-VolumesNegativeTest-1307115821 None] Created volume successfully. Jun 26 22:13:12 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf Jun 26 22:13:12 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Acquiring lock "cinder-quobyte-e145fe89-8853-4230-b7de-b12d2fe4a0a2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-e145fe89-8853-4230-b7de-b12d2fe4a0a2" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba23c0c-3165-4aad-b71c-6d314c3f07b0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:13 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 Jun 26 22:13:13 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:13 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-e9e64cbd-91b5-4402-a54b-698d6229b32f req-f1584385-80e9-4db1-bae6-b18f5e431603 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf" returned: 0 in 0.758s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-e9e64cbd-91b5-4402-a54b-698d6229b32f req-f1584385-80e9-4db1-bae6-b18f5e431603 tempest-TestStampPattern-1819556658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.787s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.589s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1576399409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a2661c7-1dd5-42eb-a65b-e06ac218c00e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7842885abc924aa2a6617caf09594383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:09Z,use_quota=True,user_id='5f1e7844b63d49609c87d21dfac17bb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Creating volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:13:13 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:13 devstack sudo[107632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e 1073741824 Jun 26 22:13:13 devstack sudo[107632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-e9e64cbd-91b5-4402-a54b-698d6229b32f req-f1584385-80e9-4db1-bae6-b18f5e431603 tempest-TestStampPattern-1819556658 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-e65a24d4-9084-4535-984c-2feb64588adf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2888326d-3f08-439b-8e03-ab93f1cbbbdc', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:13:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-e9e64cbd-91b5-4402-a54b-698d6229b32f req-f1584385-80e9-4db1-bae6-b18f5e431603 tempest-TestStampPattern-1819556658 None] attachment_update completed successfully. Jun 26 22:13:13 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2" returned: 0 in 0.866s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:13 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2 Jun 26 22:13:13 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:14 devstack sudo[107632]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e 1073741824" returned: 0 in 1.172s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:14 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e145fe89-8853-4230-b7de-b12d2fe4a0a2" returned: 0 in 0.900s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-e145fe89-8853-4230-b7de-b12d2fe4a0a2" released by "delete_volume" :: held 1.827s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:14 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e Jun 26 22:13:14 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:14 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Created reservations ['738e8831-93d1-404b-9aac-8e49eb60b9e7'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:14 devstack cinder-volume[93616]: WARNING cinder.quota [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1138045877 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1138045877, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:13:14 devstack cinder-volume[93616]: WARNING cinder.quota [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1138045877 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1138045877, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:13:14 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Created reservations ['80795dee-4133-405e-94ad-5ebbd96e746a', '1ec712dd-c7c1-49b6-b3d3-b5369f78e6d8', '3ef2f86a-7ac8-41c1-8047-28b7eca4ffff', '5dcbacc1-dec9-4824-bfd8-82c2040d32a4'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:15 devstack sudo[107716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:15 devstack sudo[107716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:15 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" returned: 0 in 0.781s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (116d2ab0-23d2-4802-8e1d-7272feba3d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd215d10-4348-4b1b-88e4-a5fa2e135c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Volume volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e (2a2661c7-1dd5-42eb-a65b-e06ac218c00e): created successfully Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd215d10-4348-4b1b-88e4-a5fa2e135c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Flow 'volume_create_manager' (b91c8051-2740-48a8-9c24-ca01d7f5fe76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Acquiring lock "cinder-quobyte-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4111a5f1-1340-4236-8037-c659bb0ef9cc tempest-VolumesSnapshotListTestJSON-245369786 None] Created volume successfully. Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" acquired by "delete_volume" :: waited 0.070s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[947167f2-1e76-4461-b302-5b049805be50]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:15 devstack sudo[107716]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.909s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:15 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-651972e1-d35c-4125-a87a-dc2a900807f6 tempest-GroupsV314Test-1688756435 None] Delete group completed successfully. Jun 26 22:13:16 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd Jun 26 22:13:16 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:16 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" returned: 0 in 0.760s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:16 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd Jun 26 22:13:16 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Creating offline snapshot e536f961-348a-431a-8d8c-29baf45213f1 of volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e5e391-8d9d-45bc-8349-3a892a08ed12]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:17 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e Jun 26 22:13:17 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:17 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" returned: 0 in 0.738s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Lock "cinder-quobyte-eda5dc22-75f5-409f-be7b-9d125d0e2dbd" released by "delete_volume" :: held 1.609s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Created reservations ['6e20f57f-28a1-4134-92a2-5112e15338b5'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Created reservations ['fc2d3007-e673-4142-b41d-81dcea50a71a', 'e2d38c92-c8b8-4ff9-80c0-d02596357482', '3f298efd-c5ce-4f6a-ad79-61828125e3b3', 'fe336a7d-2ab4-4ae6-a430-201cb19ec510'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:17 devstack sudo[108049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:17 devstack sudo[108049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:18 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" returned: 0 in 0.870s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:18 devstack sudo[108055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 1G Jun 26 22:13:18 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:18 devstack sudo[108049]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.682s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:18 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e23f43fd-96bc-4bd2-83e2-faeff38c3be3 tempest-GroupsV314Test-1688756435 None] Delete group completed successfully. Jun 26 22:13:19 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 1G" returned: 0 in 0.995s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:19 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 Jun 26 22:13:19 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:20 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1" returned: 0 in 1.014s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:20 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 is being set with open permissions: ugo+rw Jun 26 22:13:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:20 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 Jun 26 22:13:20 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:21 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1" returned: 0 in 1.062s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:21 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.info Jun 26 22:13:21 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:22 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.info" returned: 0 in 1.114s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:22 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.info is being set with open permissions: ugo+rw Jun 26 22:13:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:22 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-38f0920a-744d-411a-99d6-4b6dc4d76726 req-63dd9ae3-401a-4f71-ac77-c46b88eefe82 tempest-TestStampPattern-1819556658 None] Terminate volume connection completed successfully. Jun 26 22:13:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-38f0920a-744d-411a-99d6-4b6dc4d76726 req-63dd9ae3-401a-4f71-ac77-c46b88eefe82 tempest-TestStampPattern-1819556658 None] Deleting attachment 2888326d-3f08-439b-8e03-ab93f1cbbbdc. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:13:22 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.info Jun 26 22:13:22 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:23 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.info" returned: 0 in 0.904s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.087s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b1861f1f-d297-456d-bd76-a8a6a99c203b tempest-VolumesSnapshotListTestJSON-245369786 None] Create snapshot completed successfully Jun 26 22:13:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Creating offline snapshot 90a15365-008e-4ce4-aa4c-cafe6e96400d of volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:13:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a74061-f01e-4df8-80f0-acd50ca5ad26]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:24 devstack sudo[108155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 Jun 26 22:13:24 devstack sudo[108155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:24 devstack sudo[108155]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1" returned: 0 in 1.048s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:24 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d 1G Jun 26 22:13:24 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:25 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d 1G" returned: 0 in 1.044s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:25 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d Jun 26 22:13:25 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:27 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d" returned: 0 in 1.362s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:27 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d is being set with open permissions: ugo+rw Jun 26 22:13:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:27 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d Jun 26 22:13:27 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:28 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d" returned: 0 in 0.750s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.378s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:28 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-023886ad-84e1-40b1-8934-12f73acbf081 tempest-VolumesSnapshotListTestJSON-245369786 None] Create snapshot completed successfully Jun 26 22:13:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Creating offline snapshot 554dd47f-3d59-4b9c-a626-f4dc3db6d3ef of volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:13:29 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3807da64-00af-4ed8-884c-eb4af1dbdc3f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:29 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d Jun 26 22:13:29 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:30 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d" returned: 0 in 1.642s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:31 devstack sudo[108313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef 1G Jun 26 22:13:31 devstack sudo[108313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:32 devstack sudo[108313]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef 1G" returned: 0 in 1.137s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:32 devstack sudo[108322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef Jun 26 22:13:32 devstack sudo[108322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-e65a24d4-9084-4535-984c-2feb64588adf-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Lock "cinder-e65a24d4-9084-4535-984c-2feb64588adf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-quobyte-e65a24d4-9084-4535-984c-2feb64588adf" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-e65a24d4-9084-4535-984c-2feb64588adf" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3161daa-79e3-4918-810b-d532ba2ea2c9]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:32 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf Jun 26 22:13:32 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:33 devstack sudo[108322]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" returned: 0 in 1.265s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:33 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef is being set with open permissions: ugo+rw Jun 26 22:13:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:33 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef Jun 26 22:13:33 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:33 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf" returned: 0 in 1.335s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:33 devstack sudo[108335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf Jun 26 22:13:33 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:34 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" returned: 0 in 0.783s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.992s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-aafe6a70-5fc2-4193-8ecb-c6ff1b37e13f tempest-VolumesSnapshotListTestJSON-245369786 None] Create snapshot completed successfully Jun 26 22:13:34 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e65a24d4-9084-4535-984c-2feb64588adf" returned: 0 in 0.963s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-e65a24d4-9084-4535-984c-2feb64588adf" released by "delete_volume" :: held 2.394s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Created reservations ['ae5b097d-a662-4ce5-8049-320cb3ecb68d', 'c1b474cc-cb57-40ca-a3cc-1cc9881edb91', '1ded1fa5-145f-48e3-8d6c-cb626144da66', '20bfeab1-aa97-453a-8ad1-8b6579799866'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:35 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:35 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-554dd47f-3d59-4b9c-a626-f4dc3db6d3ef-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-554dd47f-3d59-4b9c-a626-f4dc3db6d3ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-quobyte-554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:36 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.334s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:36 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Deleted volume successfully. Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" acquired by "_delete_snapshot" :: waited 0.093s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Deleting offline snapshot 554dd47f-3d59-4b9c-a626-f4dc3db6d3ef of volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] snapshot_file for this snap is: volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4959ed33-bc7a-41c0-988d-69a3ed37833f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Flow 'volume_create_manager' (f6cf3862-5017-4ac7-a085-76bb237cda30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c206d90f-d2bf-40e9-946f-e633f8d5c480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4d295e54-b75b-4320-90d0-b8d642d98ca4 tempest-TestStampPattern-1819556658 None] Lock "cinder-e65a24d4-9084-4535-984c-2feb64588adf-delete_volume" released by "delete_volume" :: held 4.245s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-5764b4af-59cb-4090-ad2d-62c35ff5dd4a-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c206d90f-d2bf-40e9-946f-e633f8d5c480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1845933116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e423faf-2135-4f9a-af82-0b53c4f38a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d816c38606ea47d0a667f126f90db612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:36Z,use_quota=True,user_id='d72f92c59f6045a582117f046128bbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2106f901-62d7-4d6d-af8b-b94f60e3fd81),volume_type_id=2106f901-62d7-4d6d-af8b-b94f60e3fd81)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a53fb76-7865-4f47-8624-01da04c42b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a53fb76-7865-4f47-8624-01da04c42b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108876be-117a-47cc-9d53-1af4a5a8d0d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108876be-117a-47cc-9d53-1af4a5a8d0d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e423faf-2135-4f9a-af82-0b53c4f38a48', 'volume_name': 'volume-5e423faf-2135-4f9a-af82-0b53c4f38a48', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87f22f7-cc80-48d1-910d-7add4160fce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87f22f7-cc80-48d1-910d-7add4160fce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548fab83-13b3-4868-9bca-45f06ca043e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:36 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Volume 5e423faf-2135-4f9a-af82-0b53c4f38a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e423faf-2135-4f9a-af82-0b53c4f38a48', 'volume_size': 1} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1845933116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e423faf-2135-4f9a-af82-0b53c4f38a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d816c38606ea47d0a667f126f90db612',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:36Z,use_quota=True,user_id='d72f92c59f6045a582117f046128bbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2106f901-62d7-4d6d-af8b-b94f60e3fd81),volume_type_id=2106f901-62d7-4d6d-af8b-b94f60e3fd81)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Creating volume 5e423faf-2135-4f9a-af82-0b53c4f38a48 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:13:36 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Lock "cinder-5764b4af-59cb-4090-ad2d-62c35ff5dd4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.092s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-quobyte-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:36 devstack sudo[108382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 1073741824 Jun 26 22:13:36 devstack sudo[108382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:36 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef Jun 26 22:13:36 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" acquired by "delete_snapshot" :: waited 0.042s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-quobyte-5764b4af-59cb-4090-ad2d-62c35ff5dd4a" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-5764b4af-59cb-4090-ad2d-62c35ff5dd4a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Deleting offline snapshot 5764b4af-59cb-4090-ad2d-62c35ff5dd4a of volume 41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] snapshot_file for this snap is: volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffe18c0-914b-42b7-bf8e-94fc4136cb82]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:36 devstack sudo[108385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a Jun 26 22:13:36 devstack sudo[108385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:37 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:37 devstack sudo[108382]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" returned: 0 in 1.068s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 1073741824" returned: 0 in 1.006s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fdc036-72ef-458c-84d8-514ea6e63000]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:37 devstack sudo[108399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 Jun 26 22:13:37 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:37 devstack sudo[108397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d Jun 26 22:13:37 devstack sudo[108397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:37 devstack sudo[108385]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a" returned: 0 in 1.038s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fccf02-a684-48e3-be69-b7b3231f47bb]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:37 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:13:37 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:38 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48" returned: 0 in 0.843s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] <== create_volume: return (1913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.916s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (548fab83-13b3-4868-9bca-45f06ca043e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e423faf-2135-4f9a-af82-0b53c4f38a48', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8625687f-330e-43f0-99ab-a56a3128f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Volume volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 (5e423faf-2135-4f9a-af82-0b53c4f38a48): created successfully Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8625687f-330e-43f0-99ab-a56a3128f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Flow 'volume_create_manager' (f6cf3862-5017-4ac7-a085-76bb237cda30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b25752cf-11f4-4eb6-8ae4-837ab0877345 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Created volume successfully. Jun 26 22:13:38 devstack sudo[108397]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d" returned: 0 in 1.010s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:38 devstack sudo[108409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef Jun 26 22:13:38 devstack sudo[108409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:38 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 1.069s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:38 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a Jun 26 22:13:38 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:39 devstack sudo[108409]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" returned: 0 in 0.965s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:39 devstack sudo[108424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef Jun 26 22:13:39 devstack sudo[108424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:39 devstack sudo[108426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:39 devstack sudo[108426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:39 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a" returned: 0 in 0.856s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:39 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a Jun 26 22:13:39 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:40 devstack sudo[108424]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" returned: 0 in 0.736s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:40 devstack sudo[108426]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-554dd47f-3d59-4b9c-a626-f4dc3db6d3ef" released by "_delete_snapshot" :: held 3.996s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.681s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" released by "delete_snapshot" :: held 4.102s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-529ae6b6-fd31-4e5a-a89f-4c9680007a49 tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Retype volume completed successfully. Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Created reservations ['1e50483c-810c-4064-b7ab-65ea267169f5', '0f59a5d5-906c-4142-994d-44a678676da4', '23cabbb2-9c84-41c7-a407-890b42878f8c', 'ffcae994-7ecc-4328-880a-77ad41d09ce3'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:40 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f.5764b4af-59cb-4090-ad2d-62c35ff5dd4a" returned: 0 in 0.745s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-5764b4af-59cb-4090-ad2d-62c35ff5dd4a" released by "_delete_snapshot" :: held 3.837s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Delete snapshot completed successfully. Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" released by "delete_snapshot" :: held 3.866s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-70ae49f4-7bf2-40ca-88d0-16cbb360dd4f tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-554dd47f-3d59-4b9c-a626-f4dc3db6d3ef-delete_snapshot" released by "delete_snapshot" :: held 4.300s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Created reservations ['7c9f2590-81b8-4a7f-a3e1-13f8598d7996', '86afa559-876d-46bb-841b-12a57b230131', '47285f00-5249-482e-9166-a8c54de4d8c7', 'def9348a-e9a7-4b5b-b0eb-81899249c36a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Delete snapshot completed successfully. Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-176ef5f0-4c49-4d22-b661-cb1443326506 tempest-TestStampPattern-1819556658 None] Lock "cinder-5764b4af-59cb-4090-ad2d-62c35ff5dd4a-delete_snapshot" released by "delete_snapshot" :: held 4.053s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Acquiring lock "cinder-5e423faf-2135-4f9a-af82-0b53c4f38a48-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "cinder-5e423faf-2135-4f9a-af82-0b53c4f38a48-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Acquiring lock "cinder-quobyte-5e423faf-2135-4f9a-af82-0b53c4f38a48" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "cinder-quobyte-5e423faf-2135-4f9a-af82-0b53c4f38a48" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf174753-0fd9-48c2-91ef-b009d4a35476]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:41 devstack sudo[108433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 Jun 26 22:13:41 devstack sudo[108433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-90a15365-008e-4ce4-aa4c-cafe6e96400d-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-90a15365-008e-4ce4-aa4c-cafe6e96400d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-quobyte-90a15365-008e-4ce4-aa4c-cafe6e96400d" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-90a15365-008e-4ce4-aa4c-cafe6e96400d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Deleting offline snapshot 90a15365-008e-4ce4-aa4c-cafe6e96400d of volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] snapshot_file for this snap is: volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[12785cce-0c81-41f9-ab9c-38c68eb67105]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:41 devstack sudo[108437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d Jun 26 22:13:41 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:41 devstack sudo[108433]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48" returned: 0 in 1.013s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:42 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48 Jun 26 22:13:42 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:42 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d" returned: 0 in 1.084s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:42 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb59cb-8073-49e6-83bd-c42b5a965ed4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:42 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5e423faf-2135-4f9a-af82-0b53c4f38a48" returned: 0 in 0.839s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "cinder-quobyte-5e423faf-2135-4f9a-af82-0b53c4f38a48" released by "delete_volume" :: held 1.907s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:42 devstack cinder-volume[93616]: WARNING cinder.quota [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:13:42 devstack cinder-volume[93616]: WARNING cinder.quota [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:13:42 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Created reservations ['04c72641-e7f7-49f9-a2e6-d450d595b7a5', '098a3fbc-aab6-43a6-89eb-76f51abc542f', '752e4fc0-d8e0-4f72-b38a-920662ac4b5c', '8ba7bebb-fa68-4da9-8410-a337dce72748'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:42 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 Jun 26 22:13:42 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:43 devstack sudo[108456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:43 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:44 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1" returned: 0 in 1.262s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:44 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d Jun 26 22:13:44 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:44 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.387s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:44 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Deleted volume successfully. Jun 26 22:13:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8b45249a-b6e9-42f5-bb80-a2b69aa61c3c tempest-VolumeRetypeWithoutMigrationTest-516165885 None] Lock "cinder-5e423faf-2135-4f9a-af82-0b53c4f38a48-delete_volume" released by "delete_volume" :: held 3.588s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:45 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d" returned: 0 in 1.016s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:45 devstack sudo[108515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d Jun 26 22:13:45 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:45 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.90a15365-008e-4ce4-aa4c-cafe6e96400d" returned: 0 in 0.837s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-90a15365-008e-4ce4-aa4c-cafe6e96400d" released by "_delete_snapshot" :: held 4.391s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" released by "delete_snapshot" :: held 4.419s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Created reservations ['c44a229b-4514-407e-83f3-10378dda3f13', 'c4a61c17-72f2-4b8c-a0a3-d9a4fed434bc', '61093001-2818-4faa-9124-56feed74fa1b', '554e02ca-0a90-4f1b-9284-44cd3e514bc1'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Delete snapshot completed successfully. Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f6713edd-7849-4df5-bc50-4ca066847b39 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-90a15365-008e-4ce4-aa4c-cafe6e96400d-delete_snapshot" released by "delete_snapshot" :: held 4.602s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:46 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:46 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-e536f961-348a-431a-8d8c-29baf45213f1-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-e536f961-348a-431a-8d8c-29baf45213f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-quobyte-e536f961-348a-431a-8d8c-29baf45213f1" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-e536f961-348a-431a-8d8c-29baf45213f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Deleting offline snapshot e536f961-348a-431a-8d8c-29baf45213f1 of volume 2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:13:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] snapshot_file for this snap is: volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc93940-1349-4c9c-bbc3-b9d601789069]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:47 devstack sudo[108523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 Jun 26 22:13:47 devstack sudo[108523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:47 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.950s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:13:47 devstack sudo[108523]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1" returned: 0 in 0.912s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99eb288-4eda-415d-bcc1-bd22ae1ccdb5]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:48 devstack sudo[108530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e Jun 26 22:13:48 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:48 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" returned: 0 in 0.848s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:48 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 Jun 26 22:13:48 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Lock "cinder-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Acquiring lock "cinder-quobyte-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" acquired by "delete_volume" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cf4f7c-7dc9-4970-992e-0a8ee4fb8be6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:49 devstack sudo[108537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:13:49 devstack sudo[108537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:49 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1" returned: 0 in 1.022s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:49 devstack sudo[108544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1 Jun 26 22:13:49 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:50 devstack sudo[108537]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 0.970s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:50 devstack sudo[108550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f Jun 26 22:13:50 devstack sudo[108550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Acquiring lock "cinder-71c53997-757c-4e08-8623-1996715324a0-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Flow 'volume_create_manager' (a9c8cfb9-98a7-4fbb-a9dc-1f68f35f6269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b4306d-97bf-47a6-bc4d-db1cf31471df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Lock "cinder-71c53997-757c-4e08-8623-1996715324a0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:50 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e.e536f961-348a-431a-8d8c-29baf45213f1" returned: 0 in 0.860s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b4306d-97bf-47a6-bc4d-db1cf31471df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2042783285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d792a8-b30f-4d12-9388-2e393ac0aee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6e768f329d4d7b9ea0db6ee51803a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:51Z,use_quota=True,user_id='13bca53b91c94382ab1f4dfd9035b4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3649443-43a5-46e5-b098-3955030ac04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3649443-43a5-46e5-b098-3955030ac04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e363ebe-c63b-48d7-8182-ee5a83dfb3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e363ebe-c63b-48d7-8182-ee5a83dfb3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d792a8-b30f-4d12-9388-2e393ac0aee5', 'volume_name': 'volume-24d792a8-b30f-4d12-9388-2e393ac0aee5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb841d6f-34b0-40d2-b711-2b6806180c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb841d6f-34b0-40d2-b711-2b6806180c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9ec391-676d-449e-a442-5b3aeb75a827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:50 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Volume 24d792a8-b30f-4d12-9388-2e393ac0aee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d792a8-b30f-4d12-9388-2e393ac0aee5', 'volume_size': 1} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2042783285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d792a8-b30f-4d12-9388-2e393ac0aee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a6e768f329d4d7b9ea0db6ee51803a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:51Z,use_quota=True,user_id='13bca53b91c94382ab1f4dfd9035b4c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Creating volume 24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:13:50 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:50 devstack sudo[108553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 1073741824 Jun 26 22:13:50 devstack sudo[108553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-e536f961-348a-431a-8d8c-29baf45213f1" released by "_delete_snapshot" :: held 3.873s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Acquiring lock "cinder-quobyte-71c53997-757c-4e08-8623-1996715324a0" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" released by "delete_snapshot" :: held 3.902s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Lock "cinder-quobyte-71c53997-757c-4e08-8623-1996715324a0" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14c2c67-71a2-43a1-bd9d-b7403c3ceec2]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:50 devstack sudo[108550]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" returned: 0 in 0.731s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Lock "cinder-quobyte-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f" released by "delete_volume" :: held 1.788s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:50 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Created reservations ['9bf2b3be-4910-49c9-acd5-8526b774a2f7', 'af4e54e8-961a-483e-bdd2-1d27f134f5e3', 'a724d410-728f-449c-bf5a-ecac6655e2a0', '8b24998e-ad60-4a39-a228-81bb96c8e446'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:51 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 Jun 26 22:13:51 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Created reservations ['66b05623-0154-4cd6-a4ce-748d7ce683e1', '3e994153-5fbf-4fd8-b6b9-a292c6496c66', '3c636df7-61c5-4c20-9c15-c078776de83e', '47360d12-b634-4ae2-8f14-97c91fae0352'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Delete snapshot completed successfully. Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fe9eb8c3-1b27-4f5f-a864-ce97467dd7c6 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-e536f961-348a-431a-8d8c-29baf45213f1-delete_snapshot" released by "delete_snapshot" :: held 4.195s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:51 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:51 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-2a2661c7-1dd5-42eb-a65b-e06ac218c00e-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-2a2661c7-1dd5-42eb-a65b-e06ac218c00e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16ae845-72e5-4690-ab5e-6706de6e6ffc]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:51 devstack sudo[108561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e Jun 26 22:13:51 devstack sudo[108561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:51 devstack sudo[108553]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 1073741824" returned: 0 in 1.244s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:52 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0" returned: 0 in 1.187s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:52 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:52 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0 Jun 26 22:13:52 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.980s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:52 devstack sudo[108572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 Jun 26 22:13:52 devstack sudo[108572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Deleted volume successfully. Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6e1e3d70-1e9f-4f41-9c6f-563efca4a5ba tempest-TestStampPattern-1819556658 None] Lock "cinder-41056b2d-8e6a-42bb-b4e4-3bfe46cf398f-delete_volume" released by "delete_volume" :: held 3.104s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:52 devstack sudo[108561]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" returned: 0 in 1.030s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:52 devstack sudo[108578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e Jun 26 22:13:52 devstack sudo[108578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:52 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-71c53997-757c-4e08-8623-1996715324a0" returned: 0 in 0.748s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Lock "cinder-quobyte-71c53997-757c-4e08-8623-1996715324a0" released by "delete_volume" :: held 1.994s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:52 devstack sudo[108572]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5" returned: 0 in 0.803s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9ec391-676d-449e-a442-5b3aeb75a827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d792a8-b30f-4d12-9388-2e393ac0aee5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77404cf6-fd38-47fa-b9ff-c6f88ac592fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:52 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Volume volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 (24d792a8-b30f-4d12-9388-2e393ac0aee5): created successfully Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77404cf6-fd38-47fa-b9ff-c6f88ac592fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Flow 'volume_create_manager' (a9c8cfb9-98a7-4fbb-a9dc-1f68f35f6269) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:52 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Created reservations ['ec224919-2c5f-4459-8e7f-fa8bc400e12e', '4240ffcb-6eb2-42f6-bce0-09815133f3de', 'f9835727-3cdf-47fa-97f5-03edd6376a9e', '0f27eced-fac7-4c0c-82c3-1cc1727965bb'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0defd8ba-86bf-44b5-8271-e941b89022d9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Created volume successfully. Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:53 devstack sudo[108582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:53 devstack sudo[108582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:53 devstack sudo[108578]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" returned: 0 in 0.830s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-quobyte-2a2661c7-1dd5-42eb-a65b-e06ac218c00e" released by "delete_volume" :: held 1.948s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Created reservations ['0e66fbef-d35d-4dcf-b006-c1f14a06fa85', '30c5976b-1c13-44a7-8e04-f6ce8f86bb68', '15aeaf15-6c01-4b6d-9565-3fa3763f6fdc', '84280a76-a50d-41f6-80a2-3e2b6b71004d'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:53 devstack sudo[108585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:13:53 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:53 devstack sudo[108582]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.768s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Deleted volume successfully. Jun 26 22:13:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-36c1ee33-ff82-43de-89cb-759698d841ab tempest-VolumesNegativeTest-1307115821 None] Lock "cinder-71c53997-757c-4e08-8623-1996715324a0-delete_volume" released by "delete_volume" :: held 3.229s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Creating offline snapshot 53d5f650-594c-4fbb-815e-473a5d5f830a of volume 24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadff81f-3a60-4be3-bb09-9f6b7fa16550]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:54 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.026s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:13:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Deleted volume successfully. Jun 26 22:13:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3610ade6-d841-4d17-a2b3-7d84ccd2cd70 tempest-VolumesSnapshotListTestJSON-245369786 None] Lock "cinder-2a2661c7-1dd5-42eb-a65b-e06ac218c00e-delete_volume" released by "delete_volume" :: held 3.223s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:13:54 devstack sudo[108590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 Jun 26 22:13:54 devstack sudo[108590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:55 devstack sudo[108590]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5" returned: 0 in 0.861s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:55 devstack sudo[108596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a 1G Jun 26 22:13:55 devstack sudo[108596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:56 devstack sudo[108596]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a 1G" returned: 0 in 1.109s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:56 devstack sudo[108602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a Jun 26 22:13:56 devstack sudo[108602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:57 devstack sudo[108602]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a" returned: 0 in 1.055s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:57 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a is being set with open permissions: ugo+rw Jun 26 22:13:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:57 devstack sudo[108608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a Jun 26 22:13:57 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:58 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a" returned: 0 in 0.946s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:58 devstack sudo[108611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.info Jun 26 22:13:58 devstack sudo[108611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Flow 'volume_create_manager' (a225e01e-13cf-4845-a873-9641ae4cb34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4d768e-6bd2-43d6-985c-b9820cc73f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc4d768e-6bd2-43d6-985c-b9820cc73f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1939259648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947569f1-42ed-48e1-b136-dded8665b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a5c87afcb4b3db0d5ee6c03a0c296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:59Z,use_quota=True,user_id='e2451251655e4000bacaf0a7abe00750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cf14d4-a2cb-472f-89ea-ca84e27057c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cf14d4-a2cb-472f-89ea-ca84e27057c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea98d769-e5a2-4a13-8b49-698e31d5fdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea98d769-e5a2-4a13-8b49-698e31d5fdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '947569f1-42ed-48e1-b136-dded8665b30c', 'volume_name': 'volume-947569f1-42ed-48e1-b136-dded8665b30c', 'volume_size': 2}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0292a7e-6d41-4fca-85c4-56438f3b6022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0292a7e-6d41-4fca-85c4-56438f3b6022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dc60d4-5131-4266-a298-d15eb90ce14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:13:58 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Volume 947569f1-42ed-48e1-b136-dded8665b30c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-947569f1-42ed-48e1-b136-dded8665b30c', 'volume_size': 2} Jun 26 22:13:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:13:59 devstack sudo[108611]: pam_unix(sudo:session): session closed for user root Jun 26 22:13:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.info" returned: 0 in 0.873s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:13:59 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.info is being set with open permissions: ugo+rw Jun 26 22:13:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:13:59 devstack sudo[108615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.info Jun 26 22:13:59 devstack sudo[108615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:00 devstack sudo[108615]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.info" returned: 0 in 0.885s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.855s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1939259648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=947569f1-42ed-48e1-b136-dded8665b30c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='067a5c87afcb4b3db0d5ee6c03a0c296',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:13:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:13:59Z,use_quota=True,user_id='e2451251655e4000bacaf0a7abe00750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Creating volume 947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:00 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c 2147483648 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:00 devstack sudo[108618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c 2147483648 Jun 26 22:14:00 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:00 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d0f0bcc6-8b3e-4ca6-a996-708b14406be4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Create snapshot completed successfully Jun 26 22:14:01 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c 2147483648" returned: 0 in 1.231s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:01 devstack sudo[108624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c Jun 26 22:14:01 devstack sudo[108624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "cinder-53d5f650-594c-4fbb-815e-473a5d5f830a-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-53d5f650-594c-4fbb-815e-473a5d5f830a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "cinder-quobyte-24d792a8-b30f-4d12-9388-2e393ac0aee5" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-quobyte-24d792a8-b30f-4d12-9388-2e393ac0aee5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "cinder-quobyte-53d5f650-594c-4fbb-815e-473a5d5f830a" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-quobyte-53d5f650-594c-4fbb-815e-473a5d5f830a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Deleting offline snapshot 53d5f650-594c-4fbb-815e-473a5d5f830a of volume 24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] snapshot_file for this snap is: volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e80797-a724-4f58-bed1-acb05b2a7e29]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:01 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a Jun 26 22:14:01 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:02 devstack sudo[108624]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c" returned: 0 in 0.776s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] <== create_volume: return (2052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.057s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70dc60d4-5131-4266-a298-d15eb90ce14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-947569f1-42ed-48e1-b136-dded8665b30c', 'volume_size': 2}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62938794-8de8-4b9d-bc30-8c7cf04462d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:02 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Volume volume-947569f1-42ed-48e1-b136-dded8665b30c (947569f1-42ed-48e1-b136-dded8665b30c): created successfully Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62938794-8de8-4b9d-bc30-8c7cf04462d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Flow 'volume_create_manager' (a225e01e-13cf-4845-a873-9641ae4cb34f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:02 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-66b82d30-bd48-4c49-ab9f-96f0512c15a3 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Created volume successfully. Jun 26 22:14:02 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a" returned: 0 in 1.084s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24d792a8-b30f-4d12-9388-2e393ac0aee5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd4c251-3f7d-4e75-ab2c-160c76055738]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:02 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 Jun 26 22:14:02 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Creating offline snapshot f6fc5c65-78bc-4e19-b94f-fe66533f2128 of volume 947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:14:03 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0b786-433b-4a79-b6ca-1237856c4a21]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:03 devstack sudo[108636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c Jun 26 22:14:03 devstack sudo[108636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5" returned: 0 in 1.219s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:04 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:04 devstack sudo[108641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a Jun 26 22:14:04 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:04 devstack sudo[108636]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c" returned: 0 in 1.099s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 2G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:04 devstack sudo[108646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 2G Jun 26 22:14:04 devstack sudo[108646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:05 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a" returned: 0 in 1.055s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:05 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a Jun 26 22:14:05 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:05 devstack sudo[108646]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 2G" returned: 0 in 0.965s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947569f1-42ed-48e1-b136-dded8665b30c -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:05 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947569f1-42ed-48e1-b136-dded8665b30c -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 Jun 26 22:14:05 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:05 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5.53d5f650-594c-4fbb-815e-473a5d5f830a" returned: 0 in 0.822s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-quobyte-53d5f650-594c-4fbb-815e-473a5d5f830a" released by "_delete_snapshot" :: held 4.367s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-quobyte-24d792a8-b30f-4d12-9388-2e393ac0aee5" released by "delete_snapshot" :: held 4.398s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:06 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Created reservations ['2918ac75-4013-4dcb-92ac-f49973d0e06e', 'd02cb112-e8f7-462b-90a8-0be07a757ee5', '157befcf-002b-4d48-8759-99407e5fab66', 'ddfd2656-34d2-4b62-989e-667ae5c276a5'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:14:06 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Delete snapshot completed successfully. Jun 26 22:14:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c2d3892-876d-4033-9ce3-3ea55c74c325 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-53d5f650-594c-4fbb-815e-473a5d5f830a-delete_snapshot" released by "delete_snapshot" :: held 4.692s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:06 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-947569f1-42ed-48e1-b136-dded8665b30c -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128" returned: 0 in 0.922s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:06 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 is being set with open permissions: ugo+rw Jun 26 22:14:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:06 devstack sudo[108699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 Jun 26 22:14:06 devstack sudo[108699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "cinder-24d792a8-b30f-4d12-9388-2e393ac0aee5-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-24d792a8-b30f-4d12-9388-2e393ac0aee5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "cinder-quobyte-24d792a8-b30f-4d12-9388-2e393ac0aee5" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-quobyte-24d792a8-b30f-4d12-9388-2e393ac0aee5" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f777bd-4fa0-49a1-aaa0-a63206ac3840]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:07 devstack sudo[108703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 Jun 26 22:14:07 devstack sudo[108703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:07 devstack sudo[108699]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128" returned: 0 in 1.086s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:07 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.info Jun 26 22:14:07 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:08 devstack sudo[108703]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5" returned: 0 in 1.054s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:08 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5 Jun 26 22:14:08 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:08 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.info" returned: 0 in 0.992s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:08 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.info is being set with open permissions: ugo+rw Jun 26 22:14:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:08 devstack sudo[108714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.info Jun 26 22:14:08 devstack sudo[108714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:09 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-24d792a8-b30f-4d12-9388-2e393ac0aee5" returned: 0 in 1.019s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:09 devstack sudo[108714]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.info" returned: 0 in 0.813s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-quobyte-24d792a8-b30f-4d12-9388-2e393ac0aee5" released by "delete_volume" :: held 2.202s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e2dfaaca-639c-4868-835e-79359097b5f5 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Create snapshot completed successfully Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Created reservations ['dfc270ec-c6dc-46c3-a73d-46854649e1b9', 'f16adc49-e5b7-4b16-bc0e-4733561bd582', 'b6f4c641-4d76-4539-a3fa-6a680c701e2a', 'e020b9a3-e793-43aa-b7d0-62bc4bda9a48'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:09 devstack sudo[108719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:14:09 devstack sudo[108719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "cinder-f6fc5c65-78bc-4e19-b94f-fe66533f2128-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-f6fc5c65-78bc-4e19-b94f-fe66533f2128-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "cinder-quobyte-947569f1-42ed-48e1-b136-dded8665b30c" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-quobyte-947569f1-42ed-48e1-b136-dded8665b30c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "cinder-quobyte-f6fc5c65-78bc-4e19-b94f-fe66533f2128" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-quobyte-f6fc5c65-78bc-4e19-b94f-fe66533f2128" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Deleting offline snapshot f6fc5c65-78bc-4e19-b94f-fe66533f2128 of volume 947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] snapshot_file for this snap is: volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1935e5-c919-4abe-8dfe-c5182db778a6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:10 devstack sudo[108721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 Jun 26 22:14:10 devstack sudo[108721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:10 devstack sudo[108719]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.762s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:10 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:14:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Deleted volume successfully. Jun 26 22:14:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-21d41871-4a05-440b-a301-1f1bdc342916 tempest-VolumeSnapshotQuotasNegativeTestJSON-1913801914 None] Lock "cinder-24d792a8-b30f-4d12-9388-2e393ac0aee5-delete_volume" released by "delete_volume" :: held 3.232s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:11 devstack sudo[108721]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128" returned: 0 in 1.238s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-947569f1-42ed-48e1-b136-dded8665b30c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfa49a0-967b-4755-8a35-52c2c44b3997]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:11 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c Jun 26 22:14:11 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=123,cinder:SELECT=103,cinder:INSERT=31,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=129,cinder:INSERT=31,cinder:DELETE=9,cinder:SELECT=118 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Flow 'volume_create_manager' (6bb06c7b-80f2-40a8-a03c-5a5f6d7c72d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02bf300-2fe1-4c8e-91ff-05b4c0fa3deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c02bf300-2fe1-4c8e-91ff-05b4c0fa3deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22171b90-6b00-4dac-a0d7-cec60a3adbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa418cdeb434a2c8ab359ecbabd5b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:12Z,use_quota=True,user_id='92c08375da2d41c5809eb7f310aa786c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(898d539a-9b2f-4572-881a-887388f3ae25),volume_type_id=898d539a-9b2f-4572-881a-887388f3ae25)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330eb072-dc22-469c-b0e3-046beb9a53db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330eb072-dc22-469c-b0e3-046beb9a53db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb54c2d4-73d7-4694-8ba7-d7af3aee50cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:11 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:14:12 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c" returned: 0 in 1.028s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:12 devstack sudo[108732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 Jun 26 22:14:12 devstack sudo[108732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb54c2d4-73d7-4694-8ba7-d7af3aee50cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '22171b90-6b00-4dac-a0d7-cec60a3adbd6', 'volume_name': 'volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6', 'volume_size': 1, 'image_id': '83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1dfab819ca4270295025d98cd30bb79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4aa418cdeb434a2c8ab359ecbabd5b8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75434f8e046aa032fba63e71ad271d02052ab6313e40a11cb3c61fc2093ab83388041c080864cdd82e230de7caaf1bc03be4f0b45094819f7333bac06e29cbad', 'id': '83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'created_at': datetime.datetime(2026, 6, 26, 20, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361a9dba-e772-404f-8a04-83b9b8561e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (361a9dba-e772-404f-8a04-83b9b8561e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73bdf59-6c89-4de8-8f29-c139514262de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Volume 22171b90-6b00-4dac-a0d7-cec60a3adbd6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6', 'volume_size': 1, 'image_id': '83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1dfab819ca4270295025d98cd30bb79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4aa418cdeb434a2c8ab359ecbabd5b8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75434f8e046aa032fba63e71ad271d02052ab6313e40a11cb3c61fc2093ab83388041c080864cdd82e230de7caaf1bc03be4f0b45094819f7333bac06e29cbad', 'id': '83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'created_at': datetime.datetime(2026, 6, 26, 20, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Trying to clone 22171b90-6b00-4dac-a0d7-cec60a3adbd6 from image 83ded1af-b937-4f02-b507-5ae07c7d3cf7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:14:12 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Image download 0.00 MB at 0.00 MB/s Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[24eeda37-6d27-4118-a4ee-d212aff3b012]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:13 devstack sudo[108734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD Jun 26 22:14:13 devstack sudo[108734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:13 devstack sudo[108732]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128" returned: 0 in 1.134s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:13 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128 Jun 26 22:14:13 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:14 devstack sudo[108734]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD" returned: 0 in 1.128s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:14 devstack sudo[108744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD Jun 26 22:14:14 devstack sudo[108744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:14 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c.f6fc5c65-78bc-4e19-b94f-fe66533f2128" returned: 0 in 1.046s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-quobyte-f6fc5c65-78bc-4e19-b94f-fe66533f2128" released by "_delete_snapshot" :: held 4.612s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-quobyte-947569f1-42ed-48e1-b136-dded8665b30c" released by "delete_snapshot" :: held 4.665s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Created reservations ['04086661-408b-41e8-aa99-05ea614ac08f', '301eb46e-00a4-44d4-bc25-c449bc3b4e75', 'f2e8918e-fd35-457c-b24a-344b511df19d', 'd5184ad0-e8da-417c-b476-9a9df5f3f09d'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:14:14 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Delete snapshot completed successfully. Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ce01898b-6547-4858-be1e-a124570a3967 tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-f6fc5c65-78bc-4e19-b94f-fe66533f2128-delete_snapshot" released by "delete_snapshot" :: held 4.861s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:14 devstack sudo[108744]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD" returned: 1 in 0.962s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:14:14 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Temporary image 83ded1af-b937-4f02-b507-5ae07c7d3cf7 is fetched for user 92c08375da2d41c5809eb7f310aa786c. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd010aa-04e9-4af4-8623-5f6672efaf26]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:15 devstack sudo[108751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD Jun 26 22:14:15 devstack sudo[108751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "cinder-947569f1-42ed-48e1-b136-dded8665b30c-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-947569f1-42ed-48e1-b136-dded8665b30c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "cinder-quobyte-947569f1-42ed-48e1-b136-dded8665b30c" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-quobyte-947569f1-42ed-48e1-b136-dded8665b30c" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe727831-99d6-4b5f-b781-3d2648ec2619]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:15 devstack sudo[108753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c Jun 26 22:14:15 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:16 devstack sudo[108751]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD" returned: 0 in 1.142s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:16 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD Jun 26 22:14:16 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:16 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c" returned: 0 in 1.106s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:16 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c Jun 26 22:14:16 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:17 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD" returned: 1 in 1.008s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:11Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22171b90-6b00-4dac-a0d7-cec60a3adbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa418cdeb434a2c8ab359ecbabd5b8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:12Z,use_quota=True,user_id='92c08375da2d41c5809eb7f310aa786c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(898d539a-9b2f-4572-881a-887388f3ae25),volume_type_id=898d539a-9b2f-4572-881a-887388f3ae25)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Creating volume 22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:17 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:17 devstack sudo[108767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 1073741824 Jun 26 22:14:17 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:17 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-947569f1-42ed-48e1-b136-dded8665b30c" returned: 0 in 0.897s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-quobyte-947569f1-42ed-48e1-b136-dded8665b30c" released by "delete_volume" :: held 2.125s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Created reservations ['1133e05d-4cd3-4a66-9fa4-5916d559dd66', 'ec12c8e9-420c-4bf0-9c49-55dac830fd12', '9944da74-c423-4d99-86e6-5dc074259315', '248a58ff-8eab-451b-a268-ea841b3e1e1d'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:17 devstack sudo[108772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:14:17 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:18 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 1073741824" returned: 0 in 1.268s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:18 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 Jun 26 22:14:18 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:18 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.787s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:18 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:14:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Deleted volume successfully. Jun 26 22:14:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-051c2677-8a36-44d8-829b-d6984af3d3ff tempest-VolumesSnapshotNegativeTestJSON-869149350 None] Lock "cinder-947569f1-42ed-48e1-b136-dded8665b30c-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:19 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6" returned: 0 in 0.958s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.297s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:19 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Attempting download of 83ded1af-b937-4f02-b507-5ae07c7d3cf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'metadata': {}}])) to volume 22171b90-6b00-4dac-a0d7-cec60a3adbd6. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:14:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a3326a-f4c8-4ba0-9091-d59b3edba0de]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83ded1af-b937-4f02-b507-5ae07c7d3cf7_4l604spy {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:19 devstack sudo[108782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83ded1af-b937-4f02-b507-5ae07c7d3cf7_4l604spy Jun 26 22:14:19 devstack sudo[108782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:20 devstack sudo[108782]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83ded1af-b937-4f02-b507-5ae07c7d3cf7_4l604spy" returned: 0 in 0.969s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83ded1af-b937-4f02-b507-5ae07c7d3cf7_4l604spy {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:20 devstack sudo[108786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83ded1af-b937-4f02-b507-5ae07c7d3cf7_4l604spy Jun 26 22:14:20 devstack sudo[108786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:21 devstack sudo[108786]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83ded1af-b937-4f02-b507-5ae07c7d3cf7_4l604spy" returned: 1 in 1.075s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83ded1af-b937-4f02-b507-5ae07c7d3cf7_4l604spy' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:14:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f158e0e5-0bbd-433e-94da-8348dba4ced6]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:21 devstack sudo[108790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD Jun 26 22:14:21 devstack sudo[108790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:22 devstack sudo[108790]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD" returned: 0 in 0.949s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:22 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD Jun 26 22:14:22 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:23 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD" returned: 1 in 0.971s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:14:23 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] 83ded1af-b937-4f02-b507-5ae07c7d3cf7 was raw, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:14:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:23 devstack sudo[108800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 Jun 26 22:14:23 devstack sudo[108800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:24 devstack sudo[108800]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6" returned: 0 in 1.011s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:24 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83ded1af-b937-4f02-b507-5ae07c7d3cf7_gks12hegdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:14:24 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Converted 0.00 MB image at 0.00 MB/s Jun 26 22:14:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:24 devstack sudo[108807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 1G Jun 26 22:14:24 devstack sudo[108807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:25 devstack sudo[108807]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 1G" returned: 0 in 1.012s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:25 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[46881ca4-78c9-4a91-9445-6c047a37363a]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:25 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 Jun 26 22:14:25 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:26 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6" returned: 0 in 0.902s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:26 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 Jun 26 22:14:26 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:27 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6" returned: 1 in 0.963s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Downloaded image 83ded1af-b937-4f02-b507-5ae07c7d3cf7 ((None, [{'url': 'file:///opt/stack/data/glance/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'metadata': {}}])) to volume 22171b90-6b00-4dac-a0d7-cec60a3adbd6 successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Temporary image 83ded1af-b937-4f02-b507-5ae07c7d3cf7 for user 92c08375da2d41c5809eb7f310aa786c is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Marking volume 22171b90-6b00-4dac-a0d7-cec60a3adbd6 as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Copying metadata from image 83ded1af-b937-4f02-b507-5ae07c7d3cf7 to 22171b90-6b00-4dac-a0d7-cec60a3adbd6. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Creating volume glance metadata for volume 22171b90-6b00-4dac-a0d7-cec60a3adbd6 backed by image 83ded1af-b937-4f02-b507-5ae07c7d3cf7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e1dfab819ca4270295025d98cd30bb79', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c73bdf59-6c89-4de8-8f29-c139514262de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6', 'volume_size': 1, 'image_id': '83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e1dfab819ca4270295025d98cd30bb79', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4aa418cdeb434a2c8ab359ecbabd5b8f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '75434f8e046aa032fba63e71ad271d02052ab6313e40a11cb3c61fc2093ab83388041c080864cdd82e230de7caaf1bc03be4f0b45094819f7333bac06e29cbad', 'id': '83ded1af-b937-4f02-b507-5ae07c7d3cf7', 'created_at': datetime.datetime(2026, 6, 26, 20, 14, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 14, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83ded1af-b937-4f02-b507-5ae07c7d3cf7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fd154d-58eb-4b50-91ae-784001ff4a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:27 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Volume volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 (22171b90-6b00-4dac-a0d7-cec60a3adbd6): created successfully Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fd154d-58eb-4b50-91ae-784001ff4a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:27 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Flow 'volume_create_manager' (6bb06c7b-80f2-40a8-a03c-5a5f6d7c72d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:27 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-2b3901f7-3370-429f-9c15-c73bdb163fdf tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Created volume successfully. Jun 26 22:14:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Acquiring lock "cinder-22171b90-6b00-4dac-a0d7-cec60a3adbd6-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "cinder-22171b90-6b00-4dac-a0d7-cec60a3adbd6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Acquiring lock "cinder-quobyte-22171b90-6b00-4dac-a0d7-cec60a3adbd6" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:14:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "cinder-quobyte-22171b90-6b00-4dac-a0d7-cec60a3adbd6" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:14:28 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf081c23-61e8-4207-acee-8f72ec0c2e33]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:28 devstack sudo[108822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 Jun 26 22:14:28 devstack sudo[108822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:29 devstack sudo[108822]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6" returned: 0 in 1.116s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:29 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 Jun 26 22:14:29 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:30 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6" returned: 1 in 0.974s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:14:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:30 devstack sudo[108831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6 Jun 26 22:14:30 devstack sudo[108831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:31 devstack sudo[108831]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-22171b90-6b00-4dac-a0d7-cec60a3adbd6" returned: 0 in 0.758s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "cinder-quobyte-22171b90-6b00-4dac-a0d7-cec60a3adbd6" released by "delete_volume" :: held 2.943s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:31 devstack cinder-volume[93616]: WARNING cinder.quota [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:14:31 devstack cinder-volume[93616]: WARNING cinder.quota [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Created reservations ['758c1db6-4d19-467f-950f-411b3251e05b', '4e1f093b-13b3-4f96-a962-9b606681e205', '8ad5e5c4-dfb0-433b-930a-7baab98ddce8', '7b4449a6-03e7-4bab-8894-074ddf993899'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:31 devstack sudo[108834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:14:31 devstack sudo[108834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:32 devstack sudo[108834]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.935s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:32 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:14:32 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Deleted volume successfully. Jun 26 22:14:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4ab09da2-48b5-416b-938b-a6171b1e0be8 tempest-VolumeAndVolumeTypeFromImageTest-1594578170 None] Lock "cinder-22171b90-6b00-4dac-a0d7-cec60a3adbd6-delete_volume" released by "delete_volume" :: held 4.211s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Flow 'volume_create_manager' (3aead2a1-e694-4bcd-9480-3ca64bdec1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c35f660-2bae-47cb-b61b-b606f2020877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c35f660-2bae-47cb-b61b-b606f2020877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-586319432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef0e139-5d74-429e-ac53-dcab95a48d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f20f99ae293479aa523b493b9ecefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:37Z,use_quota=True,user_id='9e871fb46bc2421e951731e1be8a91c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a9fc57-78aa-4d99-8989-a4e24a1c2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a9fc57-78aa-4d99-8989-a4e24a1c2b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9970594-4443-47b4-9fa4-14788d397160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9970594-4443-47b4-9fa4-14788d397160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef0e139-5d74-429e-ac53-dcab95a48d8a', 'volume_name': 'volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208b3f52-63da-4548-9e07-aba70a470a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (208b3f52-63da-4548-9e07-aba70a470a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be546c35-e821-40ca-8992-d29d50fe1858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:37 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Volume 8ef0e139-5d74-429e-ac53-dcab95a48d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a', 'volume_size': 1} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-586319432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef0e139-5d74-429e-ac53-dcab95a48d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f20f99ae293479aa523b493b9ecefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:37Z,use_quota=True,user_id='9e871fb46bc2421e951731e1be8a91c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Creating volume 8ef0e139-5d74-429e-ac53-dcab95a48d8a {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:37 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:37 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a 1073741824 Jun 26 22:14:37 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:38 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a 1073741824" returned: 0 in 1.186s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:38 devstack sudo[108848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a Jun 26 22:14:38 devstack sudo[108848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:39 devstack sudo[108848]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a" returned: 0 in 0.865s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be546c35-e821-40ca-8992-d29d50fe1858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d0c435-f463-499b-9282-0788717b3f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Volume volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a (8ef0e139-5d74-429e-ac53-dcab95a48d8a): created successfully Jun 26 22:14:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94d0c435-f463-499b-9282-0788717b3f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Flow 'volume_create_manager' (3aead2a1-e694-4bcd-9480-3ca64bdec1d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4532c911-ce63-4450-9bcc-1c28e6dbbc20 tempest-VolumesListAdminTestJSON-840487611 None] Created volume successfully. Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (d6068ba7-1d81-4a8e-baba-d718cc04486a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc82a8d9-54d2-4db0-80c0-a341beafc87a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Flow 'volume_create_manager' (ba2ab296-64ba-45d1-9cbf-c1a16b2d582f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11e149b-be16-41e0-ad21-a23965ac06c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc82a8d9-54d2-4db0-80c0-a341beafc87a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1311020181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a036daf2-35e9-4ef6-b39a-e9da2e0a0227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:41Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e9aa77-47d5-4971-909a-2b3d8737c98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5e9aa77-47d5-4971-909a-2b3d8737c98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82cf446-f2e1-4344-bddb-7fc29c2de4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82cf446-f2e1-4344-bddb-7fc29c2de4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a036daf2-35e9-4ef6-b39a-e9da2e0a0227', 'volume_name': 'volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ccd131-5116-452b-a616-b37ef0519169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ccd131-5116-452b-a616-b37ef0519169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e3033f-8a06-4ce7-8131-f5c9dffc986f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume a036daf2-35e9-4ef6-b39a-e9da2e0a0227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227', 'volume_size': 1} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1311020181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a036daf2-35e9-4ef6-b39a-e9da2e0a0227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:41Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Creating volume a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:41 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a11e149b-be16-41e0-ad21-a23965ac06c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2127053893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86976295-2085-4f2c-97c5-a3052fddc122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f20f99ae293479aa523b493b9ecefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:41Z,use_quota=True,user_id='9e871fb46bc2421e951731e1be8a91c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack sudo[108853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 1073741824 Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d2553f-ff32-4407-8116-469f33a55627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d2553f-ff32-4407-8116-469f33a55627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c432db-ef15-4a18-8aba-70301a84c279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c432db-ef15-4a18-8aba-70301a84c279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86976295-2085-4f2c-97c5-a3052fddc122', 'volume_name': 'volume-86976295-2085-4f2c-97c5-a3052fddc122', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a255f1e-954c-4a75-b1e2-bc7be4b23361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a255f1e-954c-4a75-b1e2-bc7be4b23361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967c9098-f066-446a-8760-368f03017367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:41 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Volume 86976295-2085-4f2c-97c5-a3052fddc122: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86976295-2085-4f2c-97c5-a3052fddc122', 'volume_size': 1} Jun 26 22:14:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:42 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 1073741824" returned: 0 in 1.227s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:43 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 Jun 26 22:14:43 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:43 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" returned: 0 in 1.004s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.313s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2127053893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86976295-2085-4f2c-97c5-a3052fddc122,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f20f99ae293479aa523b493b9ecefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:41Z,use_quota=True,user_id='9e871fb46bc2421e951731e1be8a91c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Creating volume 86976295-2085-4f2c-97c5-a3052fddc122 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:43 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14e3033f-8a06-4ce7-8131-f5c9dffc986f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:44 devstack sudo[108886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 1073741824 Jun 26 22:14:44 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b6e7af-dd2d-4615-b46b-21c80836d218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:44 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 (a036daf2-35e9-4ef6-b39a-e9da2e0a0227): created successfully Jun 26 22:14:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b6e7af-dd2d-4615-b46b-21c80836d218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (d6068ba7-1d81-4a8e-baba-d718cc04486a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d4e29b23-ba51-4691-8135-5605a0dee096 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created volume successfully. Jun 26 22:14:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:45 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 1073741824" returned: 0 in 1.085s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:45 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 Jun 26 22:14:45 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:45 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122" returned: 0 in 0.823s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] <== create_volume: return (1993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.267s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Creating offline snapshot 6aaa458d-29f2-4771-8865-93943c6e20ed of volume a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967c9098-f066-446a-8760-368f03017367) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86976295-2085-4f2c-97c5-a3052fddc122', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87787221-b764-4d50-8cdf-29bd844bbd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[deb3b4a8-6e3b-4be4-8ff7-0b65ae6acabf]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:46 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Volume volume-86976295-2085-4f2c-97c5-a3052fddc122 (86976295-2085-4f2c-97c5-a3052fddc122): created successfully Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87787221-b764-4d50-8cdf-29bd844bbd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Flow 'volume_create_manager' (ba2ab296-64ba-45d1-9cbf-c1a16b2d582f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7ab8ad36-7336-4207-b37a-9e0715c02327 tempest-VolumesListAdminTestJSON-840487611 None] Created volume successfully. Jun 26 22:14:46 devstack sudo[108915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 Jun 26 22:14:46 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:46 devstack sudo[108917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:14:46 devstack sudo[108917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:46 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" returned: 0 in 0.904s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:46 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed 1G Jun 26 22:14:46 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:47 devstack sudo[108917]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.833s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Flow 'volume_create_manager' (98ff07ad-dd76-4624-8db9-a72fc1127194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f65b8-4f66-4217-93e4-7bed818f5e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f63f65b8-4f66-4217-93e4-7bed818f5e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1011527488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1038c2e9-3e0f-46d7-b357-8c7eae2e2739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f20f99ae293479aa523b493b9ecefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:47Z,use_quota=True,user_id='9e871fb46bc2421e951731e1be8a91c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95adbc87-9a65-4ba5-aa60-9ff0a8cbb5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95adbc87-9a65-4ba5-aa60-9ff0a8cbb5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f07d4ad-b5e6-430f-8759-31eab2d7f092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f07d4ad-b5e6-430f-8759-31eab2d7f092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1038c2e9-3e0f-46d7-b357-8c7eae2e2739', 'volume_name': 'volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cd3102-d970-45ef-b43d-c9e48d5d03f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58cd3102-d970-45ef-b43d-c9e48d5d03f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc0c95-dcea-4a20-af57-f975c5695ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:47 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Volume 1038c2e9-3e0f-46d7-b357-8c7eae2e2739: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739', 'volume_size': 1} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:47 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed 1G" returned: 0 in 1.053s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:48 devstack sudo[108931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed Jun 26 22:14:48 devstack sudo[108931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:48 devstack sudo[108931]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed" returned: 0 in 0.746s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:48 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed is being set with open permissions: ugo+rw Jun 26 22:14:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:48 devstack sudo[108936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed Jun 26 22:14:48 devstack sudo[108936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:49 devstack sudo[108936]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed" returned: 0 in 0.702s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:49 devstack sudo[108949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.info Jun 26 22:14:49 devstack sudo[108949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:50 devstack sudo[108949]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.info" returned: 0 in 1.176s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:50 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.info is being set with open permissions: ugo+rw Jun 26 22:14:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:50 devstack sudo[109016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.info Jun 26 22:14:50 devstack sudo[109016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:51 devstack sudo[109016]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.info" returned: 0 in 0.798s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.548s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.921s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1011527488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1038c2e9-3e0f-46d7-b357-8c7eae2e2739,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f20f99ae293479aa523b493b9ecefbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:47Z,use_quota=True,user_id='9e871fb46bc2421e951731e1be8a91c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Creating volume 1038c2e9-3e0f-46d7-b357-8c7eae2e2739 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:51 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:51 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 1073741824 Jun 26 22:14:51 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f5f88cdd-86d6-431e-9ee7-24ea86e69e42 tempest-CreateVolumesFromSnapshotTest-277189872 None] Create snapshot completed successfully Jun 26 22:14:52 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 1073741824" returned: 0 in 1.397s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:53 devstack sudo[109033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 Jun 26 22:14:53 devstack sudo[109033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (deaa93c8-3be3-4e4d-b14d-9aae0ed3fc19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3d68d8-4e95-4a67-8537-06efc869dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3d68d8-4e95-4a67-8537-06efc869dc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334094027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4cca9e-e2aa-471f-85f4-64859f2737bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:53Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daba3914-4a06-48f2-85e1-f2949bb7ffe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daba3914-4a06-48f2-85e1-f2949bb7ffe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ea6103-0631-4382-9bd1-be71ff02b9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ea6103-0631-4382-9bd1-be71ff02b9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4cca9e-e2aa-471f-85f4-64859f2737bf', 'volume_name': 'volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae896c8-dee5-42cb-8f80-8180df07412d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ae896c8-dee5-42cb-8f80-8180df07412d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b09c95e-1de1-44de-b70c-7055caa5b040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:53 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume fd4cca9e-e2aa-471f-85f4-64859f2737bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf', 'volume_size': 1} Jun 26 22:14:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (c31d44f3-8d20-4fc5-a433-f9ea02e8fd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64e24f5-5471-4c30-9cb0-73292df2e6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64e24f5-5471-4c30-9cb0-73292df2e6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025186782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dceee87d-3637-453c-b037-193dd3c510cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:54Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5f5026-5c4b-4279-a4cc-c07234f7d99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d5f5026-5c4b-4279-a4cc-c07234f7d99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761c1b95-fbfa-4b9c-b3eb-991045a28969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (761c1b95-fbfa-4b9c-b3eb-991045a28969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dceee87d-3637-453c-b037-193dd3c510cb', 'volume_name': 'volume-dceee87d-3637-453c-b037-193dd3c510cb', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8a9623-d4ee-4078-b4a6-7d40302f1fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc8a9623-d4ee-4078-b4a6-7d40302f1fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e99c317-c2bc-4dae-b753-28bb22392b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:54 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume dceee87d-3637-453c-b037-193dd3c510cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dceee87d-3637-453c-b037-193dd3c510cb', 'volume_size': 1} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:54 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (9e6d40fa-500c-4990-b541-dbd16e88a144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049d74f3-2311-4a6e-a417-ddf3017177b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (049d74f3-2311-4a6e-a417-ddf3017177b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1142214162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b446c582-78ac-4baa-a807-0d12077ef1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:55Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b1a950-ba19-4f0f-bad5-9e1a9b503b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b1a950-ba19-4f0f-bad5-9e1a9b503b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2749b8cf-2c6d-4e3f-a26a-b926a0fa4278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2749b8cf-2c6d-4e3f-a26a-b926a0fa4278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b446c582-78ac-4baa-a807-0d12077ef1a2', 'volume_name': 'volume-b446c582-78ac-4baa-a807-0d12077ef1a2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bc5dd0-017d-4e41-bdb3-51b5645666e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5bc5dd0-017d-4e41-bdb3-51b5645666e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205ea50a-6736-4d18-89ea-8b0c22a890a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume b446c582-78ac-4baa-a807-0d12077ef1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b446c582-78ac-4baa-a807-0d12077ef1a2', 'volume_size': 1} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:55 devstack sudo[109033]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739" returned: 0 in 2.181s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] <== create_volume: return (3673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.677s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.838s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334094027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4cca9e-e2aa-471f-85f4-64859f2737bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:53Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Creating volume fd4cca9e-e2aa-471f-85f4-64859f2737bf {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:55 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6bc0c95-dcea-4a20-af57-f975c5695ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582767ad-d992-4f4e-a1af-7745e47809f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Volume volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 (1038c2e9-3e0f-46d7-b357-8c7eae2e2739): created successfully Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582767ad-d992-4f4e-a1af-7745e47809f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Flow 'volume_create_manager' (98ff07ad-dd76-4624-8db9-a72fc1127194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:55 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf 1073741824 Jun 26 22:14:55 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:55 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c2a5dff0-de89-481c-8f0d-cc498f518dca tempest-VolumesListAdminTestJSON-840487611 None] Created volume successfully. Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (fc4eec2c-5b31-4a63-952f-bfb20b00ff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082a03e1-ca8a-4998-b4c1-0378b06142f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (082a03e1-ca8a-4998-b4c1-0378b06142f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145967679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818c587e-1e9d-4c0c-b906-aac052d578c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:55Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69323fc1-e151-4944-9518-5dfb97c80b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69323fc1-e151-4944-9518-5dfb97c80b87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2d3e71-0b81-487a-a944-d719ba244923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2d3e71-0b81-487a-a944-d719ba244923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '818c587e-1e9d-4c0c-b906-aac052d578c6', 'volume_name': 'volume-818c587e-1e9d-4c0c-b906-aac052d578c6', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4dff99-48e2-4e28-83bf-4935fb34bc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a4dff99-48e2-4e28-83bf-4935fb34bc2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2046e9-673d-4b53-96f2-d94a095d8ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:55 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume 818c587e-1e9d-4c0c-b906-aac052d578c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-818c587e-1e9d-4c0c-b906-aac052d578c6', 'volume_size': 1} Jun 26 22:14:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (d8e748e1-2de6-40b0-b972-3e7e25fb6041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64371e6-330d-4d12-8dff-6bea308cc9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64371e6-330d-4d12-8dff-6bea308cc9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714978675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0768599d-6f41-46a4-b6f2-99072a03064f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:56Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cb9a23-45ac-48b8-b3f8-ea5a6de843ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75cb9a23-45ac-48b8-b3f8-ea5a6de843ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87336a84-13a5-4cc7-af84-90124cbd7f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87336a84-13a5-4cc7-af84-90124cbd7f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0768599d-6f41-46a4-b6f2-99072a03064f', 'volume_name': 'volume-0768599d-6f41-46a4-b6f2-99072a03064f', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef91f52-28a2-4013-b15d-6fbb52afe1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aef91f52-28a2-4013-b15d-6fbb52afe1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f32aa2b-2865-4809-b743-9d3c9d9c1f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume 0768599d-6f41-46a4-b6f2-99072a03064f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0768599d-6f41-46a4-b6f2-99072a03064f', 'volume_size': 1} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Flow 'volume_create_manager' (b8ac0739-fe61-4471-94db-3b6e2f92fe9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48a03c7-2f45-4244-8891-6e8e22c8a4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48a03c7-2f45-4244-8891-6e8e22c8a4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-872605220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f29b8b0-7a46-4e6d-97b6-698c4acf9556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31145fecb4094a76b3c56b2bf8219f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:57Z,use_quota=True,user_id='242dd70bb3e24b8c85264d08cb9152e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481a0a17-c336-49c2-8f1f-f49e23f51a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481a0a17-c336-49c2-8f1f-f49e23f51a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6182cfea-0151-4a5a-80d9-22a16b89e807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6182cfea-0151-4a5a-80d9-22a16b89e807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f29b8b0-7a46-4e6d-97b6-698c4acf9556', 'volume_name': 'volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe99a64-bc29-496a-97f9-31e074498f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbe99a64-bc29-496a-97f9-31e074498f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4e99b4-a751-4d99-9c71-40c49fa1d48a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Volume 3f29b8b0-7a46-4e6d-97b6-698c4acf9556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556', 'volume_size': 1} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf 1073741824" returned: 0 in 1.598s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:56 devstack sudo[109042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf Jun 26 22:14:56 devstack sudo[109042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Flow 'volume_create_manager' (614417d2-a9cb-4e56-9ee3-0a8949e47e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39deb72a-0c86-4893-bada-5a345c6cf498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39deb72a-0c86-4893-bada-5a345c6cf498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4553a8d-2987-4982-af0b-5ff40072408c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ffbd54193b4272a2fc18f94fd25026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:58Z,use_quota=True,user_id='6587fd407d1a47b2ab50d840ea3dfd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e87f351-ce76-41eb-b778-15b46ad12aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e87f351-ce76-41eb-b778-15b46ad12aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a583e1-aaf9-4d4e-8cdd-befadc2d1bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07a583e1-aaf9-4d4e-8cdd-befadc2d1bd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4553a8d-2987-4982-af0b-5ff40072408c', 'volume_name': 'volume-c4553a8d-2987-4982-af0b-5ff40072408c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aeaeb8c-5e52-47b2-9d33-840b411511fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aeaeb8c-5e52-47b2-9d33-840b411511fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8f8feb-bec3-4f78-81fd-86069f9ca45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:57 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Volume c4553a8d-2987-4982-af0b-5ff40072408c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4553a8d-2987-4982-af0b-5ff40072408c', 'volume_size': 1} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:57 devstack sudo[109042]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf" returned: 0 in 0.924s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] <== create_volume: return (2576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.583s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.230s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1025186782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dceee87d-3637-453c-b037-193dd3c510cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:54Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Creating volume dceee87d-3637-453c-b037-193dd3c510cb {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:57 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b09c95e-1de1-44de-b70c-7055caa5b040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:57 devstack sudo[109045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb 1073741824 Jun 26 22:14:57 devstack sudo[109045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a97639-774d-4a46-a070-231ba50e4172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:57 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf (fd4cca9e-e2aa-471f-85f4-64859f2737bf): created successfully Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46a97639-774d-4a46-a070-231ba50e4172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (deaa93c8-3be3-4e4d-b14d-9aae0ed3fc19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-29081262-ed91-4250-be4d-3c99fe47c048 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created volume successfully. Jun 26 22:14:58 devstack sudo[109045]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb 1073741824" returned: 0 in 0.944s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:58 devstack sudo[109051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb Jun 26 22:14:58 devstack sudo[109051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:59 devstack sudo[109051]: pam_unix(sudo:session): session closed for user root Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb" returned: 0 in 0.904s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.610s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1142214162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b446c582-78ac-4baa-a807-0d12077ef1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:55Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Creating volume b446c582-78ac-4baa-a807-0d12077ef1a2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:14:59 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e99c317-c2bc-4dae-b753-28bb22392b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dceee87d-3637-453c-b037-193dd3c510cb', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712e558f-8da8-41eb-80f2-8408391f730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:14:59 devstack sudo[109054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 1073741824 Jun 26 22:14:59 devstack sudo[109054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:14:59 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume volume-dceee87d-3637-453c-b037-193dd3c510cb (dceee87d-3637-453c-b037-193dd3c510cb): created successfully Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (712e558f-8da8-41eb-80f2-8408391f730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:14:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (c31d44f3-8d20-4fc5-a433-f9ea02e8fd20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:14:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9fbbafda-e22d-4624-9dc8-bb8e8cba68eb tempest-CreateVolumesFromSnapshotTest-277189872 None] Created volume successfully. Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Flow 'volume_create_manager' (b510df4d-2fc7-487d-bdca-60e6cc5d8b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec8353e-62ca-439d-801b-94425ac98418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec8353e-62ca-439d-801b-94425ac98418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1942306792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143c82d9-576b-4a28-8814-f9c58a216c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72f154330d04a318d1409328e2e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:00Z,use_quota=True,user_id='d5017e8321bd43b78da00460c59bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(511682fe-2dbf-4616-a73b-b873d2a97cfd),volume_type_id=511682fe-2dbf-4616-a73b-b873d2a97cfd)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672f9a42-e64b-4211-ae2d-15f0f121304e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672f9a42-e64b-4211-ae2d-15f0f121304e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba7b7c-84aa-4e4a-aa22-59441239aaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68ba7b7c-84aa-4e4a-aa22-59441239aaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '143c82d9-576b-4a28-8814-f9c58a216c67', 'volume_name': 'volume-143c82d9-576b-4a28-8814-f9c58a216c67', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d485240-59ba-46ef-b801-8dc42c18ebcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d485240-59ba-46ef-b801-8dc42c18ebcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2448044-b680-464e-987d-c541216bff03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Volume 143c82d9-576b-4a28-8814-f9c58a216c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-143c82d9-576b-4a28-8814-f9c58a216c67', 'volume_size': 1} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Flow 'volume_create_manager' (a2f02cb1-2c62-4c15-92af-7e8f1366a2a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d51ad66-0ced-4452-8b93-35c8dfa5c198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d51ad66-0ced-4452-8b93-35c8dfa5c198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2053960566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71965f5-b0e9-4a95-ad77-51b8e1beea06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72f154330d04a318d1409328e2e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:00Z,use_quota=True,user_id='d5017e8321bd43b78da00460c59bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca29b928-7aca-49d5-8736-5c88aea31dac),volume_type_id=ca29b928-7aca-49d5-8736-5c88aea31dac)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d6f8a5-2d0f-49a8-a02b-c9dc61ad3f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d6f8a5-2d0f-49a8-a02b-c9dc61ad3f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf6525f-9471-48c2-b669-2891d7ec4386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bf6525f-9471-48c2-b669-2891d7ec4386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71965f5-b0e9-4a95-ad77-51b8e1beea06', 'volume_name': 'volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9caadc9-045a-4a89-b598-2618762c534a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9caadc9-045a-4a89-b598-2618762c534a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772d8769-44e4-40b2-8b74-18fe06366397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:00 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Volume c71965f5-b0e9-4a95-ad77-51b8e1beea06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06', 'volume_size': 1} Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:00 devstack sudo[109054]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 1073741824" returned: 0 in 1.257s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:01 devstack sudo[109061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 Jun 26 22:15:01 devstack sudo[109061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Flow 'volume_create_manager' (4edadfdf-9164-4a6f-a31f-1cacb109c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3c1b7b-b58b-46b0-9b0e-2384c33ea49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a3c1b7b-b58b-46b0-9b0e-2384c33ea49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-877695827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ab2c4b-2388-4819-9158-3c1cc7b51314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72f154330d04a318d1409328e2e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:01Z,use_quota=True,user_id='d5017e8321bd43b78da00460c59bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c064c18a-78c2-40ff-a151-ce9dda787187),volume_type_id=c064c18a-78c2-40ff-a151-ce9dda787187)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ce5a19-afd2-4dd7-bbbe-003a405ad17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ce5a19-afd2-4dd7-bbbe-003a405ad17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5385b0dc-a97a-43dd-adc7-d041701a7d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5385b0dc-a97a-43dd-adc7-d041701a7d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '55ab2c4b-2388-4819-9158-3c1cc7b51314', 'volume_name': 'volume-55ab2c4b-2388-4819-9158-3c1cc7b51314', 'volume_size': 1, 'image_id': 'd54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1620659149', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e72f154330d04a318d1409328e2e9f74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'created_at': datetime.datetime(2026, 6, 26, 20, 14, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 14, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11/file', 'properties': {}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb132fc-87a8-4228-bc89-c1fbb828a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bb132fc-87a8-4228-bc89-c1fbb828a68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8553960d-d782-4110-97df-c84d419aa418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:01 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Volume 55ab2c4b-2388-4819-9158-3c1cc7b51314: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-55ab2c4b-2388-4819-9158-3c1cc7b51314', 'volume_size': 1, 'image_id': 'd54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1620659149', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e72f154330d04a318d1409328e2e9f74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'created_at': datetime.datetime(2026, 6, 26, 20, 14, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 14, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11/file', 'properties': {}}, 'image_service': } Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Trying to clone 55ab2c4b-2388-4819-9158-3c1cc7b51314 from image d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:15:01 devstack sudo[109061]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2" returned: 0 in 0.746s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] <== create_volume: return (2053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.059s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.104s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2145967679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=818c587e-1e9d-4c0c-b906-aac052d578c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:55Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Creating volume 818c587e-1e9d-4c0c-b906-aac052d578c6 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:01 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205ea50a-6736-4d18-89ea-8b0c22a890a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b446c582-78ac-4baa-a807-0d12077ef1a2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:01 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 1073741824 Jun 26 22:15:01 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebb4eaa-8bb7-488c-ba2e-1535d7482d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:01 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume volume-b446c582-78ac-4baa-a807-0d12077ef1a2 (b446c582-78ac-4baa-a807-0d12077ef1a2): created successfully Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ebb4eaa-8bb7-488c-ba2e-1535d7482d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (9e6d40fa-500c-4990-b541-dbd16e88a144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:01 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-160cc503-b851-488b-9cd2-861e8e01e724 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created volume successfully. Jun 26 22:15:02 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 1073741824" returned: 0 in 0.979s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:02 devstack sudo[109073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 Jun 26 22:15:02 devstack sudo[109073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:03 devstack sudo[109073]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6" returned: 0 in 0.789s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] <== create_volume: return (1836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.017s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1714978675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0768599d-6f41-46a4-b6f2-99072a03064f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd56928ace30429b88ecee9e06987b35',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:56Z,use_quota=True,user_id='9fccb6eb04e44ede8931b2ba88c445c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Creating volume 0768599d-6f41-46a4-b6f2-99072a03064f {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:03 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:03 devstack sudo[109076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f 1073741824 Jun 26 22:15:03 devstack sudo[109076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2046e9-673d-4b53-96f2-d94a095d8ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-818c587e-1e9d-4c0c-b906-aac052d578c6', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2991eb0c-8f75-469e-a1b6-4b6b943a0499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:03 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume volume-818c587e-1e9d-4c0c-b906-aac052d578c6 (818c587e-1e9d-4c0c-b906-aac052d578c6): created successfully Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2991eb0c-8f75-469e-a1b6-4b6b943a0499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:03 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (fc4eec2c-5b31-4a63-952f-bfb20b00ff55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-054a254e-e2af-493b-86e0-e7e2fba1ed04 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created volume successfully. Jun 26 22:15:04 devstack sudo[109076]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f 1073741824" returned: 0 in 0.944s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:04 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f Jun 26 22:15:04 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:04 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD, size 20.69 MB, duration 3.57 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:15:04 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Image download 20.69 MB at 5.79 MB/s Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[05bdaed1-af79-4baa-8398-3271c3736bd7]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:05 devstack sudo[109103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD Jun 26 22:15:05 devstack sudo[109103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:05 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f" returned: 0 in 0.740s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] <== create_volume: return (1732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.535s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-872605220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f29b8b0-7a46-4e6d-97b6-698c4acf9556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31145fecb4094a76b3c56b2bf8219f6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:57Z,use_quota=True,user_id='242dd70bb3e24b8c85264d08cb9152e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Creating volume 3f29b8b0-7a46-4e6d-97b6-698c4acf9556 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:05 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f32aa2b-2865-4809-b743-9d3c9d9c1f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0768599d-6f41-46a4-b6f2-99072a03064f', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:05 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 1073741824 Jun 26 22:15:05 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2830bd2-b1d1-4875-aea9-aa2fe4be1d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:05 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Volume volume-0768599d-6f41-46a4-b6f2-99072a03064f (0768599d-6f41-46a4-b6f2-99072a03064f): created successfully Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2830bd2-b1d1-4875-aea9-aa2fe4be1d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Flow 'volume_create_manager' (d8e748e1-2de6-40b0-b972-3e7e25fb6041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:05 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-78581df5-a49e-4825-a6ad-7a82be6c6bea tempest-CreateVolumesFromSnapshotTest-277189872 None] Created volume successfully. Jun 26 22:15:05 devstack sudo[109103]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD" returned: 0 in 0.718s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Temporary image d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 is fetched for user d5017e8321bd43b78da00460c59bcf02. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcabb35e-fe91-4a82-9a3d-210bde9999bb]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:05 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD Jun 26 22:15:05 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:06 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 1073741824" returned: 0 in 0.849s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:06 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 Jun 26 22:15:06 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-0768599d-6f41-46a4-b6f2-99072a03064f-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-0768599d-6f41-46a4-b6f2-99072a03064f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-0768599d-6f41-46a4-b6f2-99072a03064f" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-0768599d-6f41-46a4-b6f2-99072a03064f" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[af363068-fe15-464d-8b98-873383ace584]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:06 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD" returned: 0 in 0.771s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:06 devstack sudo[109124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f Jun 26 22:15:06 devstack sudo[109124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:06 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556" returned: 0 in 0.715s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.303s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4553a8d-2987-4982-af0b-5ff40072408c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ffbd54193b4272a2fc18f94fd25026',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:14:58Z,use_quota=True,user_id='6587fd407d1a47b2ab50d840ea3dfd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Creating volume c4553a8d-2987-4982-af0b-5ff40072408c {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:06 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd4e99b4-a751-4d99-9c71-40c49fa1d48a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:07 devstack sudo[109161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c 1073741824 Jun 26 22:15:07 devstack sudo[109161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5313cae8-a95c-4e77-8225-28dc85cb2121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:07 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Volume volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 (3f29b8b0-7a46-4e6d-97b6-698c4acf9556): created successfully Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5313cae8-a95c-4e77-8225-28dc85cb2121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Flow 'volume_create_manager' (b8ac0739-fe61-4471-94db-3b6e2f92fe9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:07 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e5b61146-d8b1-42cc-b000-0fcafc4c7be8 tempest-TestMinimumBasicScenario-736625124 None] Created volume successfully. Jun 26 22:15:07 devstack sudo[109124]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f" returned: 0 in 0.814s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:07 devstack sudo[109168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f Jun 26 22:15:07 devstack sudo[109168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:07 devstack sudo[109161]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c 1073741824" returned: 0 in 0.880s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:07 devstack sudo[109173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c Jun 26 22:15:07 devstack sudo[109173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:08 devstack sudo[109168]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0768599d-6f41-46a4-b6f2-99072a03064f" returned: 0 in 0.693s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-0768599d-6f41-46a4-b6f2-99072a03064f" released by "delete_volume" :: held 1.557s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created reservations ['6fd2a92d-a200-4055-9c48-eae6df23f104', '7532b375-ebd6-4234-afa7-4860959123ed', 'e8e4abba-e5bb-4222-a47c-263f80c03b38', '22cf255c-8aef-4a70-b621-64b91a1c6d90'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:08 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:08 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:08 devstack sudo[109173]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c" returned: 0 in 0.705s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.379s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1942306792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=143c82d9-576b-4a28-8814-f9c58a216c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72f154330d04a318d1409328e2e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:00Z,use_quota=True,user_id='d5017e8321bd43b78da00460c59bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(511682fe-2dbf-4616-a73b-b873d2a97cfd),volume_type_id=511682fe-2dbf-4616-a73b-b873d2a97cfd)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Creating volume 143c82d9-576b-4a28-8814-f9c58a216c67 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:08 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-818c587e-1e9d-4c0c-b906-aac052d578c6-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:08 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 1073741824 Jun 26 22:15:08 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8f8feb-bec3-4f78-81fd-86069f9ca45e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4553a8d-2987-4982-af0b-5ff40072408c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d2b9d6-ecd9-4e43-84f7-6e022923529d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-818c587e-1e9d-4c0c-b906-aac052d578c6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:08 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Volume volume-c4553a8d-2987-4982-af0b-5ff40072408c (c4553a8d-2987-4982-af0b-5ff40072408c): created successfully Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d2b9d6-ecd9-4e43-84f7-6e022923529d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Flow 'volume_create_manager' (614417d2-a9cb-4e56-9ee3-0a8949e47e1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:08 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6891bebd-3601-449e-a22e-3253282bcc3e tempest-VolumesListAdminTestJSON-159150935 None] Created volume successfully. Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-818c587e-1e9d-4c0c-b906-aac052d578c6" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-818c587e-1e9d-4c0c-b906-aac052d578c6" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093c0b8-3a16-4abc-9a31-42266f175293]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:08 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.707s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:08 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Deleted volume successfully. Jun 26 22:15:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fa754eb2-831c-4901-90d3-11eca0e14353 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-0768599d-6f41-46a4-b6f2-99072a03064f-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:08 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 Jun 26 22:15:08 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Acquiring lock "cinder-c4553a8d-2987-4982-af0b-5ff40072408c-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Lock "cinder-c4553a8d-2987-4982-af0b-5ff40072408c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:09 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 1073741824" returned: 0 in 0.989s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Acquiring lock "cinder-quobyte-c4553a8d-2987-4982-af0b-5ff40072408c" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Lock "cinder-quobyte-c4553a8d-2987-4982-af0b-5ff40072408c" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[035985e0-b584-4ef8-91a6-53be1cdf62b3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:09 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:09 devstack sudo[109193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 Jun 26 22:15:09 devstack sudo[109193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6" returned: 0 in 0.897s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "cinder-1038c2e9-3e0f-46d7-b357-8c7eae2e2739-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-1038c2e9-3e0f-46d7-b357-8c7eae2e2739-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:09 devstack sudo[109196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6 Jun 26 22:15:09 devstack sudo[109196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "cinder-quobyte-1038c2e9-3e0f-46d7-b357-8c7eae2e2739" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-quobyte-1038c2e9-3e0f-46d7-b357-8c7eae2e2739" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef82a02a-c7fc-4001-8e82-e3b6f6ba10d5]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:09 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c Jun 26 22:15:09 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:10 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 Jun 26 22:15:10 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:10 devstack sudo[109193]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.986s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2053960566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71965f5-b0e9-4a95-ad77-51b8e1beea06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72f154330d04a318d1409328e2e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:00Z,use_quota=True,user_id='d5017e8321bd43b78da00460c59bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ca29b928-7aca-49d5-8736-5c88aea31dac),volume_type_id=ca29b928-7aca-49d5-8736-5c88aea31dac)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Creating volume c71965f5-b0e9-4a95-ad77-51b8e1beea06 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:10 devstack sudo[109196]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:10 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-818c587e-1e9d-4c0c-b906-aac052d578c6" returned: 0 in 0.802s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:10 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 1073741824 Jun 26 22:15:10 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2448044-b680-464e-987d-c541216bff03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-143c82d9-576b-4a28-8814-f9c58a216c67', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8124d482-d36b-47b4-8064-5c068b94b4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-818c587e-1e9d-4c0c-b906-aac052d578c6" released by "delete_volume" :: held 1.788s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:10 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Volume volume-143c82d9-576b-4a28-8814-f9c58a216c67 (143c82d9-576b-4a28-8814-f9c58a216c67): created successfully Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8124d482-d36b-47b4-8064-5c068b94b4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Flow 'volume_create_manager' (b510df4d-2fc7-487d-bdca-60e6cc5d8b0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c6230ca0-5966-46bc-87d3-ed0ba1c388ce tempest-TestInstancesWithCinderVolumes-602323859 None] Created volume successfully. Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created reservations ['9cdffed0-223d-4b21-b5b1-df22ca55e6bd', 'e2e480aa-9651-4565-acc3-4801a41d721f', '97435461-72e6-4130-9e7f-3a6aa67e0b6d', 'e36525ed-1700-4cc9-bb09-cb5e910d73d9'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:10 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c" returned: 0 in 1.096s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:10 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739" returned: 0 in 0.922s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:10 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c Jun 26 22:15:10 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:10 devstack sudo[109212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739 Jun 26 22:15:10 devstack sudo[109212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:10 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:10 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-b446c582-78ac-4baa-a807-0d12077ef1a2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-b446c582-78ac-4baa-a807-0d12077ef1a2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-b446c582-78ac-4baa-a807-0d12077ef1a2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-b446c582-78ac-4baa-a807-0d12077ef1a2" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:11 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da6a034-3776-4ac6-8352-53434c3c0bcf]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:11 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 Jun 26 22:15:11 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:12 devstack sudo[109212]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1038c2e9-3e0f-46d7-b357-8c7eae2e2739" returned: 0 in 1.286s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=67,cinder:INSERT=25,cinder:UPDATE=83,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-quobyte-1038c2e9-3e0f-46d7-b357-8c7eae2e2739" released by "delete_volume" :: held 2.301s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=69,cinder:INSERT=20,cinder:UPDATE=81,cinder:DELETE=10 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:15:12 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 1073741824" returned: 0 in 1.713s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-c412de27-f3ab-4fe0-a371-676159cf639c req-876553db-e6dd-4c84-ab50-00bdc041386f tempest-TestMinimumBasicScenario-736625124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:12 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c4553a8d-2987-4982-af0b-5ff40072408c" returned: 0 in 1.489s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Lock "cinder-quobyte-c4553a8d-2987-4982-af0b-5ff40072408c" released by "delete_volume" :: held 2.647s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:12 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.485s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Created reservations ['8a2ec28f-8fd5-4a8c-8147-8db1eca979d9', '085f48df-fb51-4e9f-a352-c5f69109d690', 'a0bad7ea-3092-428d-a870-382eb3ad478d', 'a08c1654-78cf-4546-a265-8b7ae5752218'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:12 devstack sudo[109233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:12 devstack sudo[109233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Deleted volume successfully. Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Created reservations ['abecd76e-8edd-433a-b800-82822cd273e6', '541999a4-9f40-47dc-afac-47a187046e5f', '1ca8f46a-c00f-413e-9139-677cea1af059', 'a5d30b8c-0ff2-43d9-931c-fbd19ffb05ee'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a48c0944-1577-4aff-ba70-023566c91274 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-818c587e-1e9d-4c0c-b906-aac052d578c6-delete_volume" released by "delete_volume" :: held 3.752s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:12 devstack sudo[109239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:12 devstack sudo[109239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:12 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:12 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:12 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2" returned: 0 in 1.487s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:12 devstack sudo[109243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2 Jun 26 22:15:12 devstack sudo[109243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "cinder-86976295-2085-4f2c-97c5-a3052fddc122-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-86976295-2085-4f2c-97c5-a3052fddc122-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "cinder-quobyte-86976295-2085-4f2c-97c5-a3052fddc122" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-quobyte-86976295-2085-4f2c-97c5-a3052fddc122" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0649fa39-c07d-413b-a580-dd62d857a236]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:13 devstack sudo[109239]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.037s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Deleted volume successfully. Jun 26 22:15:13 devstack sudo[109243]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-b446c582-78ac-4baa-a807-0d12077ef1a2" returned: 0 in 0.962s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:13 devstack sudo[109233]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06" returned: 0 in 1.306s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] <== create_volume: return (3143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.146s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.026s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-877695827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ab2c4b-2388-4819-9158-3c1cc7b51314,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e72f154330d04a318d1409328e2e9f74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:01Z,use_quota=True,user_id='d5017e8321bd43b78da00460c59bcf02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c064c18a-78c2-40ff-a151-ce9dda787187),volume_type_id=c064c18a-78c2-40ff-a151-ce9dda787187)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Creating volume 55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:13 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:13 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-b446c582-78ac-4baa-a807-0d12077ef1a2" released by "delete_volume" :: held 2.561s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e48d2ef-3167-442e-96ab-fa94d20ab465 tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-1038c2e9-3e0f-46d7-b357-8c7eae2e2739-delete_volume" released by "delete_volume" :: held 3.900s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.095s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:13 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 1073741824 Jun 26 22:15:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Deleted volume successfully. Jun 26 22:15:13 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (772d8769-44e4-40b2-8b74-18fe06366397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f9af59-cdd9-4d97-b089-8e10dfb53528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d5b6ff4b-4982-4980-ab5b-044e3b43e3bb tempest-VolumesListAdminTestJSON-159150935 None] Lock "cinder-c4553a8d-2987-4982-af0b-5ff40072408c-delete_volume" released by "delete_volume" :: held 4.138s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Volume volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 (c71965f5-b0e9-4a95-ad77-51b8e1beea06): created successfully Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f9af59-cdd9-4d97-b089-8e10dfb53528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Flow 'volume_create_manager' (a2f02cb1-2c62-4c15-92af-7e8f1366a2a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a19bdfcf-2458-4163-8905-87385e956c8b tempest-TestInstancesWithCinderVolumes-602323859 None] Created volume successfully. Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created reservations ['af835921-1bfa-4022-ac79-dfd6c82d2f90', 'fb12bd9a-6574-4eaa-b427-310f548f4297', 'bce8ed59-74d6-4d43-a0e2-5985a4fd14ea', '1c6feab3-ec76-4177-9ed4-6c32fdf30fc3'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:13 devstack sudo[109249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 Jun 26 22:15:13 devstack sudo[109249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:13 devstack sudo[109253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:13 devstack sudo[109253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-dceee87d-3637-453c-b037-193dd3c510cb-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-dceee87d-3637-453c-b037-193dd3c510cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-dceee87d-3637-453c-b037-193dd3c510cb" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-dceee87d-3637-453c-b037-193dd3c510cb" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd174f3-13ec-4254-ad9c-8ed446226b9a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:14 devstack sudo[109249]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122" returned: 0 in 1.109s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:14 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122 Jun 26 22:15:14 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:14 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb Jun 26 22:15:14 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:14 devstack sudo[109253]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.758s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:14 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:14 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Deleted volume successfully. Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 1073741824" returned: 0 in 1.048s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3e7f4c34-e8b1-4da5-9a6b-9c34a4d8e418 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-b446c582-78ac-4baa-a807-0d12077ef1a2-delete_volume" released by "delete_volume" :: held 3.724s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:14 devstack sudo[109268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:15:14 devstack sudo[109268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:15 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-86976295-2085-4f2c-97c5-a3052fddc122" returned: 0 in 0.709s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:15 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb" returned: 0 in 0.828s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-quobyte-86976295-2085-4f2c-97c5-a3052fddc122" released by "delete_volume" :: held 1.901s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:15 devstack sudo[109275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb Jun 26 22:15:15 devstack sudo[109275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:15 devstack sudo[109268]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 0 in 0.668s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-c412de27-f3ab-4fe0-a371-676159cf639c req-876553db-e6dd-4c84-ab50-00bdc041386f tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.194s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a7b695-e683-41a2-9226-27858b207386]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c412de27-f3ab-4fe0-a371-676159cf639c req-876553db-e6dd-4c84-ab50-00bdc041386f tempest-TestMinimumBasicScenario-736625124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Attempting download of d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 ((None, [{'url': 'file:///opt/stack/data/glance/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'metadata': {}}])) to volume 55ab2c4b-2388-4819-9158-3c1cc7b51314. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Created reservations ['bb05d40c-e994-4148-b654-658427808003', 'df67d08b-dc30-4ce4-90a9-7b4a7dc4188c', 'd8921569-630c-4caa-9297-d2fd16e3e98e', '89388b74-574d-49ba-9600-c883aa76e802'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02814d-b983-4e95-bb85-b6eec11b6d3f]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_8xubpk8i {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:15 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 Jun 26 22:15:15 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:15 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:15 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "cinder-8ef0e139-5d74-429e-ac53-dcab95a48d8a-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:15 devstack sudo[109278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_8xubpk8i Jun 26 22:15:15 devstack sudo[109278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-8ef0e139-5d74-429e-ac53-dcab95a48d8a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "cinder-quobyte-8ef0e139-5d74-429e-ac53-dcab95a48d8a" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-quobyte-8ef0e139-5d74-429e-ac53-dcab95a48d8a" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[25198fc0-252f-46ad-b0f6-f6ac0ad2d544]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:15 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a Jun 26 22:15:15 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:16 devstack sudo[109275]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dceee87d-3637-453c-b037-193dd3c510cb" returned: 0 in 0.973s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-dceee87d-3637-453c-b037-193dd3c510cb" released by "delete_volume" :: held 1.861s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:16 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-c412de27-f3ab-4fe0-a371-676159cf639c req-876553db-e6dd-4c84-ab50-00bdc041386f tempest-TestMinimumBasicScenario-736625124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556" returned: 0 in 0.984s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-c412de27-f3ab-4fe0-a371-676159cf639c req-876553db-e6dd-4c84-ab50-00bdc041386f tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.017s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Created reservations ['7214d8da-0527-4159-969a-284b896615c9', 'a109aacc-c75d-407d-beb2-cb2217d33e7a', 'ffe1b0e3-d931-4d08-9a83-18cd3c7f9942', '3af3ff34-fb35-44b4-abf5-292063a1f53a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-c412de27-f3ab-4fe0-a371-676159cf639c req-876553db-e6dd-4c84-ab50-00bdc041386f tempest-TestMinimumBasicScenario-736625124 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75683834-9c11-42ee-a503-f6f7dd3f1ab8', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:16 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-c412de27-f3ab-4fe0-a371-676159cf639c req-876553db-e6dd-4c84-ab50-00bdc041386f tempest-TestMinimumBasicScenario-736625124 None] attachment_update completed successfully. Jun 26 22:15:16 devstack sudo[109292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:16 devstack sudo[109292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:16 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.093s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:16 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Deleted volume successfully. Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-fd4cca9e-e2aa-471f-85f4-64859f2737bf-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:16 devstack sudo[109278]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_8xubpk8i" returned: 0 in 1.186s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_8xubpk8i {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-fd4cca9e-e2aa-471f-85f4-64859f2737bf-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62066ab1-a4f8-4907-b0ab-03aa188e8b0d tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-86976295-2085-4f2c-97c5-a3052fddc122-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-fd4cca9e-e2aa-471f-85f4-64859f2737bf" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-fd4cca9e-e2aa-471f-85f4-64859f2737bf" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[699e5954-34f9-4730-b9f0-8e17d4ea0bb5]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:17 devstack sudo[109299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_8xubpk8i Jun 26 22:15:17 devstack sudo[109299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:17 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a" returned: 0 in 1.211s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:17 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf Jun 26 22:15:17 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:17 devstack sudo[109368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a Jun 26 22:15:17 devstack sudo[109368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:17 devstack sudo[109292]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.035s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Deleted volume successfully. Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-62b55f46-ec6f-4edc-8208-ed7521d3f011 tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-dceee87d-3637-453c-b037-193dd3c510cb-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:17 devstack sudo[109368]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ef0e139-5d74-429e-ac53-dcab95a48d8a" returned: 0 in 0.777s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-quobyte-8ef0e139-5d74-429e-ac53-dcab95a48d8a" released by "delete_volume" :: held 2.050s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:17 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf" returned: 0 in 0.993s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:17 devstack sudo[109299]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_8xubpk8i" returned: 1 in 1.165s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_8xubpk8i' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afcc668-4398-4fbb-8916-92d97f449e02]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:17 devstack sudo[109695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf Jun 26 22:15:17 devstack sudo[109695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:17 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Created reservations ['ca964f20-f59f-4866-b174-1fe38ce26a3c', 'f21d0464-49fb-47d8-821e-ec60cb8149d7', 'e8a12705-da7c-457e-a3a4-d4b031a748f2', '0e7a4317-93c5-4808-b348-9c46abd7741a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:18 devstack sudo[109698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD Jun 26 22:15:18 devstack sudo[109698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:18 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:18 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:18 devstack sudo[109695]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fd4cca9e-e2aa-471f-85f4-64859f2737bf" returned: 0 in 0.784s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-fd4cca9e-e2aa-471f-85f4-64859f2737bf" released by "delete_volume" :: held 1.846s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Created reservations ['da00c68d-d72a-40fc-89f5-8dbfea29e870', 'c9620e30-3f3e-4eb5-8565-1f49b3dbacee', '10c4ea54-2333-43ee-a313-3f2e5a8ceb81', 'cf10eced-9d8f-4138-8ad9-f776dbc438fc'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:18 devstack sudo[109698]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD" returned: 0 in 0.839s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 was qcow2, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:18 devstack sudo[109708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:15:18 devstack sudo[109708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:18 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.753s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Deleted volume successfully. Jun 26 22:15:18 devstack sudo[109710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:18 devstack sudo[109710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-6520a096-69b6-4bba-876a-f660861eacec tempest-VolumesListAdminTestJSON-840487611 None] Lock "cinder-8ef0e139-5d74-429e-ac53-dcab95a48d8a-delete_volume" released by "delete_volume" :: held 3.148s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-6aaa458d-29f2-4771-8865-93943c6e20ed-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-6aaa458d-29f2-4771-8865-93943c6e20ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-6aaa458d-29f2-4771-8865-93943c6e20ed" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-6aaa458d-29f2-4771-8865-93943c6e20ed" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Deleting offline snapshot 6aaa458d-29f2-4771-8865-93943c6e20ed of volume a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] snapshot_file for this snap is: volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f91b2e-5f6b-4926-b25a-05678bf437f3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:19 devstack sudo[109712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed Jun 26 22:15:19 devstack sudo[109712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:19 devstack sudo[109710]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.816s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:19 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Deleted volume successfully. Jun 26 22:15:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-85fe9384-e5cf-4de3-ae76-13634d89114c tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-fd4cca9e-e2aa-471f-85f4-64859f2737bf-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:20 devstack sudo[109712]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed" returned: 0 in 0.943s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:15:20 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e943ce31-0e2e-4d12-ad74-84e9c8d1e032]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:20 devstack sudo[109741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 Jun 26 22:15:20 devstack sudo[109741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:21 devstack sudo[109708]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 0 in 2.345s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:21 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d54e90d6-ec0a-417a-bd36-50dbb0bb6b11_vb12tv19devstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:15:21 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Converted 112.00 MB image at 47.72 MB/s Jun 26 22:15:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:21 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 1G Jun 26 22:15:21 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:21 devstack sudo[109741]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" returned: 0 in 1.094s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:21 devstack sudo[109749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed Jun 26 22:15:21 devstack sudo[109749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:22 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 1G" returned: 0 in 0.902s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:22 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f5d68f-df48-4bca-a22e-2177679afe02]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:22 devstack sudo[109757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:15:22 devstack sudo[109757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:22 devstack sudo[109749]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed" returned: 0 in 1.000s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:22 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed Jun 26 22:15:22 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:23 devstack sudo[109757]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 0 in 0.988s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:23 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227.6aaa458d-29f2-4771-8865-93943c6e20ed" returned: 0 in 0.820s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-6aaa458d-29f2-4771-8865-93943c6e20ed" released by "_delete_snapshot" :: held 4.003s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" released by "delete_snapshot" :: held 4.054s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:23 devstack sudo[109765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:15:23 devstack sudo[109765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Created reservations ['e479d9cc-025e-4111-994d-6b0e2271254b', 'ed9b7e96-ce26-42b2-a06f-cdb4de684b1c', '67caaee2-2516-4c06-86c8-b84e63e9b6bc', '1d026fb9-b0e0-4b8f-be7f-a583721830ab'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Delete snapshot completed successfully. Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b21391c5-dc33-44a6-b6cc-a431cd23949f tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-6aaa458d-29f2-4771-8865-93943c6e20ed-delete_snapshot" released by "delete_snapshot" :: held 4.295s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-a036daf2-35e9-4ef6-b39a-e9da2e0a0227-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-a036daf2-35e9-4ef6-b39a-e9da2e0a0227-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "cinder-quobyte-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" acquired by "delete_volume" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b665230a-9ced-4117-b5e7-ab578aed56c2]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:23 devstack sudo[109767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 Jun 26 22:15:23 devstack sudo[109767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:24 devstack sudo[109765]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 1 in 1.029s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Downloaded image d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 ((None, [{'url': 'file:///opt/stack/data/glance/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'metadata': {}}])) to volume 55ab2c4b-2388-4819-9158-3c1cc7b51314 successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Temporary image d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 for user d5017e8321bd43b78da00460c59bcf02 is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Marking volume 55ab2c4b-2388-4819-9158-3c1cc7b51314 as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Copying metadata from image d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 to 55ab2c4b-2388-4819-9158-3c1cc7b51314. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Creating volume glance metadata for volume 55ab2c4b-2388-4819-9158-3c1cc7b51314 backed by image d54e90d6-ec0a-417a-bd36-50dbb0bb6b11 with: {'image_id': 'd54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'image_name': 'tempest-scenario-img--1620659149', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8553960d-d782-4110-97df-c84d419aa418) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ab2c4b-2388-4819-9158-3c1cc7b51314', 'volume_size': 1, 'image_id': 'd54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1620659149', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e72f154330d04a318d1409328e2e9f74', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd54e90d6-ec0a-417a-bd36-50dbb0bb6b11', 'created_at': datetime.datetime(2026, 6, 26, 20, 14, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 14, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d54e90d6-ec0a-417a-bd36-50dbb0bb6b11/file', 'properties': {}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349c2cb8-ddbb-443c-a03e-f3a3f5a3fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:24 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Volume volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 (55ab2c4b-2388-4819-9158-3c1cc7b51314): created successfully Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349c2cb8-ddbb-443c-a03e-f3a3f5a3fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Flow 'volume_create_manager' (4edadfdf-9164-4a6f-a31f-1cacb109c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-423aae3c-23a2-4942-be18-a0ddbd9f673f tempest-TestInstancesWithCinderVolumes-602323859 None] Created volume successfully. Jun 26 22:15:24 devstack sudo[109767]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" returned: 0 in 0.839s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:24 devstack sudo[109775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227 Jun 26 22:15:24 devstack sudo[109775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:25 devstack sudo[109775]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" returned: 0 in 0.959s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-quobyte-a036daf2-35e9-4ef6-b39a-e9da2e0a0227" released by "delete_volume" :: held 1.894s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Created reservations ['411c1eb7-9a2f-4ba7-98d9-3468818b0a1c', '067f7841-2d91-4354-a71a-073757dfe8b7', '1311a4fa-c785-4c3b-8e89-8490dc2b3411', '70864cd2-2dfe-4978-af34-bdbf5a63c967'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:25 devstack sudo[109783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:25 devstack sudo[109783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:26 devstack sudo[109783]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.898s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:26 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:26 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Deleted volume successfully. Jun 26 22:15:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e39af33f-e108-4e54-a9b2-f729fd3d8abb tempest-CreateVolumesFromSnapshotTest-277189872 None] Lock "cinder-a036daf2-35e9-4ef6-b39a-e9da2e0a0227-delete_volume" released by "delete_volume" :: held 3.211s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Flow 'volume_create_manager' (bc49c2e3-8e8e-4d53-b55e-918ced15ceca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeedd04-f650-4803-8857-05ee3bd00f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeedd04-f650-4803-8857-05ee3bd00f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-506146277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6c4aac-a061-4b23-9c21-a8c554d59973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296ce4f2f2d45619500697f11031907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:30Z,use_quota=True,user_id='cbcb444947e643679a208d132e4df559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70caebc4-bbd8-4e7e-a2df-1e63c9fa9d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70caebc4-bbd8-4e7e-a2df-1e63c9fa9d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44945ec-f467-4485-a263-f75dd48dab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f44945ec-f467-4485-a263-f75dd48dab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d6c4aac-a061-4b23-9c21-a8c554d59973', 'volume_name': 'volume-1d6c4aac-a061-4b23-9c21-a8c554d59973', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75f65d5-3cc2-433c-924a-47b4fdb2bb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75f65d5-3cc2-433c-924a-47b4fdb2bb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea808153-0507-4e1f-8565-612bd8d01cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Volume 1d6c4aac-a061-4b23-9c21-a8c554d59973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d6c4aac-a061-4b23-9c21-a8c554d59973', 'volume_size': 1} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-506146277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d6c4aac-a061-4b23-9c21-a8c554d59973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296ce4f2f2d45619500697f11031907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:30Z,use_quota=True,user_id='cbcb444947e643679a208d132e4df559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Creating volume 1d6c4aac-a061-4b23-9c21-a8c554d59973 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:30 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:15:30 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 1073741824 Jun 26 22:15:30 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Flow 'volume_create_manager' (4c3227c4-6436-46d3-8595-9b879933b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4d02d6-3a55-4a90-aa54-818758226d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f4d02d6-3a55-4a90-aa54-818758226d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36510566-3940-4793-8a2e-a06815afa80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63e6af258a741ee93c342e9d4c88386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:31Z,use_quota=True,user_id='9b91c0eff799403e875a8d01ac0490be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d926db81-68b9-469a-b871-01d4eaad4881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d926db81-68b9-469a-b871-01d4eaad4881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f420d38c-9345-4c71-a357-7b616f7073c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f420d38c-9345-4c71-a357-7b616f7073c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36510566-3940-4793-8a2e-a06815afa80c', 'volume_name': 'volume-36510566-3940-4793-8a2e-a06815afa80c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86bb3c5-a43e-4f17-bc87-38e66637ea4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a86bb3c5-a43e-4f17-bc87-38e66637ea4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74251fa0-a71a-4b2d-8189-3be6a3041b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:30 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Volume 36510566-3940-4793-8a2e-a06815afa80c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36510566-3940-4793-8a2e-a06815afa80c', 'volume_size': 1} Jun 26 22:15:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:31 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 1073741824" returned: 0 in 0.889s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:31 devstack sudo[109798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 Jun 26 22:15:31 devstack sudo[109798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:32 devstack sudo[109798]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973" returned: 0 in 0.657s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.481s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:30Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36510566-3940-4793-8a2e-a06815afa80c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63e6af258a741ee93c342e9d4c88386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:31Z,use_quota=True,user_id='9b91c0eff799403e875a8d01ac0490be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Creating volume 36510566-3940-4793-8a2e-a06815afa80c {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:32 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea808153-0507-4e1f-8565-612bd8d01cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d6c4aac-a061-4b23-9c21-a8c554d59973', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee34de-18ef-437f-b92a-d7c2870ec70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:32 devstack sudo[109801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c 1073741824 Jun 26 22:15:32 devstack sudo[109801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Volume volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 (1d6c4aac-a061-4b23-9c21-a8c554d59973): created successfully Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2ee34de-18ef-437f-b92a-d7c2870ec70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Flow 'volume_create_manager' (bc49c2e3-8e8e-4d53-b55e-918ced15ceca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:32 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5641b592-235a-4d8f-b2ab-d8d99a4a6b42 tempest-VolumesTransfersV357Test-1304056565 None] Created volume successfully. Jun 26 22:15:33 devstack sudo[109801]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c 1073741824" returned: 0 in 0.991s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:33 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c Jun 26 22:15:33 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:34 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c" returned: 0 in 1.040s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] <== create_volume: return (2074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.082s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.320s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74251fa0-a71a-4b2d-8189-3be6a3041b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36510566-3940-4793-8a2e-a06815afa80c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303b3cf6-e0bd-4891-aabe-a2f7a0fb1e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f812e939-c526-4421-a5da-c47773bc52bf]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:34 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Volume volume-36510566-3940-4793-8a2e-a06815afa80c (36510566-3940-4793-8a2e-a06815afa80c): created successfully Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303b3cf6-e0bd-4891-aabe-a2f7a0fb1e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Flow 'volume_create_manager' (4c3227c4-6436-46d3-8595-9b879933b65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-87860a0f-6386-438e-888b-e31b697ebd8e tempest-VolumesTransfersV357Test-421775569 None] Transfer volume completed successfully. Jun 26 22:15:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6e809fb6-0d15-4baa-88a9-44c3a2829aa9 tempest-CinderUnicodeTest-1144726469 None] Created volume successfully. Jun 26 22:15:34 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:15:34 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:35 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 0 in 0.840s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:35 devstack sudo[109825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:15:35 devstack sudo[109825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Acquiring lock "cinder-1d6c4aac-a061-4b23-9c21-a8c554d59973-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-1d6c4aac-a061-4b23-9c21-a8c554d59973-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Flow 'volume_create_manager' (1b8836a4-079a-4d31-bcc8-07a6252e9194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af91ee8-6b19-450c-9a0a-41975a56d94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3af91ee8-6b19-450c-9a0a-41975a56d94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-671482716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5667ea32-6cc0-4b73-9965-abc227c8a82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63e6af258a741ee93c342e9d4c88386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:36Z,use_quota=True,user_id='9b91c0eff799403e875a8d01ac0490be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22964da5-b1cb-42d4-9416-263e3af531a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22964da5-b1cb-42d4-9416-263e3af531a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567c1c1b-b3bb-4d82-9a73-bd87e7ae4891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (567c1c1b-b3bb-4d82-9a73-bd87e7ae4891) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5667ea32-6cc0-4b73-9965-abc227c8a82a', 'volume_name': 'volume-5667ea32-6cc0-4b73-9965-abc227c8a82a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d818aa21-2b4a-46a4-89c1-7c1808757b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d818aa21-2b4a-46a4-89c1-7c1808757b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fecb215-f432-4e7f-af9b-3ad322690946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:36 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Volume 5667ea32-6cc0-4b73-9965-abc227c8a82a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5667ea32-6cc0-4b73-9965-abc227c8a82a', 'volume_size': 1} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Acquiring lock "cinder-quobyte-1d6c4aac-a061-4b23-9c21-a8c554d59973" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-quobyte-1d6c4aac-a061-4b23-9c21-a8c554d59973" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe689483-0bf6-4d5f-a620-b4f3eef44a9a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:36 devstack sudo[109825]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 1 in 1.023s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.928s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.076s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:36Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-671482716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5667ea32-6cc0-4b73-9965-abc227c8a82a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63e6af258a741ee93c342e9d4c88386',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:36Z,use_quota=True,user_id='9b91c0eff799403e875a8d01ac0490be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Creating volume 5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:36 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:36 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a 1073741824 Jun 26 22:15:36 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-55ab2c4b-2388-4819-9158-3c1cc7b51314', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5cd4072-3a17-43ae-b305-e98a3f01ee02', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:15:36 devstack sudo[109830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 Jun 26 22:15:36 devstack sudo[109830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:36 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-a02e837e-2ea4-4093-85af-6e7d400deef8 req-65eea022-1962-46b5-8faa-bd0884068ac8 tempest-TestInstancesWithCinderVolumes-602323859 None] attachment_update completed successfully. Jun 26 22:15:37 devstack sudo[109830]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973" returned: 0 in 0.877s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:37 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973 Jun 26 22:15:37 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:37 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a 1073741824" returned: 0 in 1.005s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:37 devstack sudo[109867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a Jun 26 22:15:37 devstack sudo[109867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:37 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-1d6c4aac-a061-4b23-9c21-a8c554d59973" returned: 0 in 0.709s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-quobyte-1d6c4aac-a061-4b23-9c21-a8c554d59973" released by "delete_volume" :: held 1.626s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:37 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Created reservations ['2e239481-f58b-40f1-9a03-84dda3c61d71', '29f53056-b297-4221-8221-3b09e50b8e52', 'f9685eaf-a443-4cb4-9f22-fc8de3f40d4d', 'cf771935-8a37-42be-a15c-da3ac1f868e5'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:38 devstack sudo[109867]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a" returned: 0 in 0.681s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:38 devstack sudo[109871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:38 devstack sudo[109871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fecb215-f432-4e7f-af9b-3ad322690946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5667ea32-6cc0-4b73-9965-abc227c8a82a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fcd5ca-f00a-4607-9be4-9eda7f63e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Volume volume-5667ea32-6cc0-4b73-9965-abc227c8a82a (5667ea32-6cc0-4b73-9965-abc227c8a82a): created successfully Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fcd5ca-f00a-4607-9be4-9eda7f63e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Flow 'volume_create_manager' (1b8836a4-079a-4d31-bcc8-07a6252e9194) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-49df3414-d784-41fd-87c3-16cff210de99 tempest-CinderUnicodeTest-1144726469 None] Created volume successfully. Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Creating offline snapshot 4e681e53-7652-4b49-9286-fcdc6cac6540 of volume 5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6609c6b-6c69-4a21-a759-350c82232bd1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:39 devstack sudo[109921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a Jun 26 22:15:39 devstack sudo[109921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Flow 'volume_create_manager' (27376d0d-b5c8-4e15-829b-0bc5785d18c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c9d3f6-f683-4377-9995-935f6a75c167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31c9d3f6-f683-4377-9995-935f6a75c167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1455482043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a34d789-1028-4cb5-a9a3-d5e0c838290e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296ce4f2f2d45619500697f11031907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:39Z,use_quota=True,user_id='cbcb444947e643679a208d132e4df559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beae7a60-ad83-47f7-82ff-a3061b97e211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beae7a60-ad83-47f7-82ff-a3061b97e211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08376f04-37ac-4fec-8fe2-a5457bad2a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08376f04-37ac-4fec-8fe2-a5457bad2a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a34d789-1028-4cb5-a9a3-d5e0c838290e', 'volume_name': 'volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f99a0f-9d39-4c54-81a8-81b186a84013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92f99a0f-9d39-4c54-81a8-81b186a84013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e715bc-78b7-48ed-a543-fdcf38d5a4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Volume 3a34d789-1028-4cb5-a9a3-d5e0c838290e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e', 'volume_size': 1} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:39 devstack sudo[109871]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.560s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Deleted volume successfully. Jun 26 22:15:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cdb683df-e6a4-408e-8238-31671bdf1bab tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-1d6c4aac-a061-4b23-9c21-a8c554d59973-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:40 devstack sudo[109921]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a" returned: 0 in 1.014s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:40 devstack sudo[109964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 1G Jun 26 22:15:40 devstack sudo[109964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:41 devstack sudo[109964]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 1G" returned: 0 in 1.176s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5667ea32-6cc0-4b73-9965-abc227c8a82a -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:41 devstack sudo[110048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5667ea32-6cc0-4b73-9965-abc227c8a82a -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 Jun 26 22:15:41 devstack sudo[110048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:42 devstack sudo[110048]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5667ea32-6cc0-4b73-9965-abc227c8a82a -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540" returned: 0 in 1.025s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:42 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 is being set with open permissions: ugo+rw Jun 26 22:15:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:42 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 Jun 26 22:15:42 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:43 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540" returned: 0 in 1.376s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:43 devstack sudo[110134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.info Jun 26 22:15:43 devstack sudo[110134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:44 devstack sudo[110134]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.info" returned: 0 in 0.677s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:44 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.info is being set with open permissions: ugo+rw Jun 26 22:15:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:44 devstack sudo[110139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.info Jun 26 22:15:44 devstack sudo[110139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:45 devstack sudo[110139]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.info" returned: 0 in 0.839s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.282s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.709s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1455482043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a34d789-1028-4cb5-a9a3-d5e0c838290e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8296ce4f2f2d45619500697f11031907',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:15:39Z,use_quota=True,user_id='cbcb444947e643679a208d132e4df559',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Creating volume 3a34d789-1028-4cb5-a9a3-d5e0c838290e {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:15:45 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:15:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:45 devstack sudo[110143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e 1073741824 Jun 26 22:15:45 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0bd42805-bdf6-4e02-a7dd-a60e67975f55 tempest-CinderUnicodeTest-1144726469 None] Create snapshot completed successfully Jun 26 22:15:45 devstack sudo[110143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:46 devstack sudo[110143]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e 1073741824" returned: 0 in 0.953s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:46 devstack sudo[110149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e Jun 26 22:15:46 devstack sudo[110149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:46 devstack sudo[110151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:46 devstack sudo[110151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "cinder-4e681e53-7652-4b49-9286-fcdc6cac6540-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-4e681e53-7652-4b49-9286-fcdc6cac6540-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "cinder-quobyte-5667ea32-6cc0-4b73-9965-abc227c8a82a" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-5667ea32-6cc0-4b73-9965-abc227c8a82a" acquired by "delete_snapshot" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "cinder-quobyte-4e681e53-7652-4b49-9286-fcdc6cac6540" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-4e681e53-7652-4b49-9286-fcdc6cac6540" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Deleting offline snapshot 4e681e53-7652-4b49-9286-fcdc6cac6540 of volume 5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] snapshot_file for this snap is: volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea367b12-05a7-43b7-9fb9-d983c376a089]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:47 devstack sudo[110153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 Jun 26 22:15:47 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:47 devstack sudo[110151]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.533s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:15:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:15:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:15:48 devstack sudo[110149]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e" returned: 0 in 1.832s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] <== create_volume: return (2845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.849s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e715bc-78b7-48ed-a543-fdcf38d5a4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b24e6-cd71-4eac-8cab-e81521101443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:15:48 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Volume volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e (3a34d789-1028-4cb5-a9a3-d5e0c838290e): created successfully Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c4b24e6-cd71-4eac-8cab-e81521101443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Flow 'volume_create_manager' (27376d0d-b5c8-4e15-829b-0bc5785d18c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:15:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-94a71ed0-ec87-4de0-9825-5d780a474957 tempest-VolumesTransfersV357Test-1304056565 None] Created volume successfully. Jun 26 22:15:48 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540" returned: 0 in 1.758s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5667ea32-6cc0-4b73-9965-abc227c8a82a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[38198860-0d18-40f7-be61-bb6fefe5d341]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:48 devstack sudo[110160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a Jun 26 22:15:48 devstack sudo[110160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Acquiring lock "cinder-3a34d789-1028-4cb5-a9a3-d5e0c838290e-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-3a34d789-1028-4cb5-a9a3-d5e0c838290e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:50 devstack sudo[110160]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a" returned: 0 in 1.556s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:50 devstack sudo[110166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 Jun 26 22:15:50 devstack sudo[110166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Acquiring lock "cinder-quobyte-3a34d789-1028-4cb5-a9a3-d5e0c838290e" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-quobyte-3a34d789-1028-4cb5-a9a3-d5e0c838290e" acquired by "delete_volume" :: waited 0.049s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c9338a-d848-42c4-93c9-be40dec9c8bd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:50 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e Jun 26 22:15:50 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:51 devstack sudo[110166]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540" returned: 0 in 1.436s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:51 devstack sudo[110177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540 Jun 26 22:15:51 devstack sudo[110177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:51 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e" returned: 0 in 1.472s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:51 devstack sudo[110179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e Jun 26 22:15:51 devstack sudo[110179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:53 devstack sudo[110179]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3a34d789-1028-4cb5-a9a3-d5e0c838290e" returned: 0 in 1.261s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-quobyte-3a34d789-1028-4cb5-a9a3-d5e0c838290e" released by "delete_volume" :: held 2.810s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:53 devstack sudo[110177]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a.4e681e53-7652-4b49-9286-fcdc6cac6540" returned: 0 in 1.636s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Created reservations ['d702848f-c9c0-485b-9548-51c00144cf8a', 'e886f9a6-25e7-4b5a-bab2-f0db3550d2df', 'b9d00602-4cf1-4ee5-af11-133918871082', '40b2ecde-581b-4369-ba7a-ebd66573cedb'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-4e681e53-7652-4b49-9286-fcdc6cac6540" released by "_delete_snapshot" :: held 6.570s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-5667ea32-6cc0-4b73-9965-abc227c8a82a" released by "delete_snapshot" :: held 6.635s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Created reservations ['688805b7-f675-45bb-96f7-e125438bfd66', '7a5584e0-0b9b-427d-a64e-a00bb6db3de8', '269a0da8-75cf-48ee-84c9-a555664a6b53', '7ed46110-20bf-48a9-9800-13b2821e4780'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:53 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:53 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Delete snapshot completed successfully. Jun 26 22:15:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-16a456ab-16c2-4b35-ab82-b3840bb71af9 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-4e681e53-7652-4b49-9286-fcdc6cac6540-delete_snapshot" released by "delete_snapshot" :: held 7.114s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "cinder-5667ea32-6cc0-4b73-9965-abc227c8a82a-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:54 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.978s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-5667ea32-6cc0-4b73-9965-abc227c8a82a-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Deleted volume successfully. Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-519d2fbc-5afe-4ff2-ae2e-a458ad332422 tempest-VolumesTransfersV357Test-1565405043 None] Lock "cinder-3a34d789-1028-4cb5-a9a3-d5e0c838290e-delete_volume" released by "delete_volume" :: held 4.462s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "cinder-quobyte-5667ea32-6cc0-4b73-9965-abc227c8a82a" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-5667ea32-6cc0-4b73-9965-abc227c8a82a" acquired by "delete_volume" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e458fa09-2075-4370-8251-fd0cbe92a028]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:54 devstack sudo[110187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a Jun 26 22:15:54 devstack sudo[110187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:56 devstack sudo[110187]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a" returned: 0 in 1.435s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:56 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a Jun 26 22:15:56 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:57 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5667ea32-6cc0-4b73-9965-abc227c8a82a" returned: 0 in 1.203s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-5667ea32-6cc0-4b73-9965-abc227c8a82a" released by "delete_volume" :: held 2.729s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Created reservations ['c15d8d54-8767-49aa-a47e-3d34ec070794', 'e5c4bec9-2b47-4db6-9907-e5ee42d1b567', 'bb5cb604-9086-4573-9ba5-e1194feaef0e', 'b285b013-13b6-4686-b41a-423f1d66eef4'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:15:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:57 devstack sudo[110210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:15:57 devstack sudo[110210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "cinder-36510566-3940-4793-8a2e-a06815afa80c-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-36510566-3940-4793-8a2e-a06815afa80c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "cinder-quobyte-36510566-3940-4793-8a2e-a06815afa80c" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-36510566-3940-4793-8a2e-a06815afa80c" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f1cced-9181-4385-a979-c8f394c093cd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:58 devstack sudo[110212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c Jun 26 22:15:58 devstack sudo[110212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:58 devstack sudo[110210]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.929s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:15:58 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Deleted volume successfully. Jun 26 22:15:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c6a06ce0-e903-4f1f-8e8c-6bb9be0eb146 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-5667ea32-6cc0-4b73-9965-abc227c8a82a-delete_volume" released by "delete_volume" :: held 4.044s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:59 devstack sudo[110212]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c" returned: 0 in 0.977s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:15:59 devstack sudo[110218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c Jun 26 22:15:59 devstack sudo[110218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:15:59 devstack sudo[110218]: pam_unix(sudo:session): session closed for user root Jun 26 22:15:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-36510566-3940-4793-8a2e-a06815afa80c" returned: 0 in 0.679s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:15:59 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-quobyte-36510566-3940-4793-8a2e-a06815afa80c" released by "delete_volume" :: held 1.716s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:15:59 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Created reservations ['0578ccec-75f7-4c8b-b8fc-877e242dd90b', 'af5c517b-f7c9-491e-9a09-1cfcc7273247', '99cafc28-63f1-44ce-b9fe-78d4879d3192', 'a036e37a-7c96-4660-9507-4923af67eb80'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:00 devstack sudo[110221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:00 devstack sudo[110221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:00 devstack sudo[110221]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.807s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:00 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Deleted volume successfully. Jun 26 22:16:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-76ff3926-2fa9-4076-95c9-dbad9518df47 tempest-CinderUnicodeTest-1144726469 None] Lock "cinder-36510566-3940-4793-8a2e-a06815afa80c-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (6a5e2a6b-ae87-45cb-b26f-fba81d0c5e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dca0dd-854f-4bd6-acea-08ee7beb2779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53dca0dd-854f-4bd6-acea-08ee7beb2779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1230024926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accf88c0-f457-439a-9373-e2a7b1fb3c30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:02Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca53238-e862-4087-8242-8e361fe72725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca53238-e862-4087-8242-8e361fe72725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb04828-1ff3-436e-8f71-f1934806b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fb04828-1ff3-436e-8f71-f1934806b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'accf88c0-f457-439a-9373-e2a7b1fb3c30', 'volume_name': 'volume-accf88c0-f457-439a-9373-e2a7b1fb3c30', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ccec16-4eb1-445a-8c4a-343a1a81fc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02ccec16-4eb1-445a-8c4a-343a1a81fc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2716701e-cff2-4ad0-bc52-c8fb2e8ce5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:02 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Volume accf88c0-f457-439a-9373-e2a7b1fb3c30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-accf88c0-f457-439a-9373-e2a7b1fb3c30', 'volume_size': 1} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1230024926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accf88c0-f457-439a-9373-e2a7b1fb3c30,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:02Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Creating volume accf88c0-f457-439a-9373-e2a7b1fb3c30 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:16:02 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:16:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:02 devstack sudo[110291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 1073741824 Jun 26 22:16:02 devstack sudo[110291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:03 devstack sudo[110291]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 1073741824" returned: 0 in 0.825s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:03 devstack sudo[110296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 Jun 26 22:16:03 devstack sudo[110296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:04 devstack sudo[110296]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30" returned: 0 in 0.642s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:16:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2716701e-cff2-4ad0-bc52-c8fb2e8ce5cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-accf88c0-f457-439a-9373-e2a7b1fb3c30', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edae799d-b5bf-4dc5-b251-3c80a8a7d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:04 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Volume volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 (accf88c0-f457-439a-9373-e2a7b1fb3c30): created successfully Jun 26 22:16:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edae799d-b5bf-4dc5-b251-3c80a8a7d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:04 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (6a5e2a6b-ae87-45cb-b26f-fba81d0c5e73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:04 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1cddba6a-e1b3-4cbe-896e-865444ec7e7e tempest-VolumesGetTest-1531496375 None] Created volume successfully. Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (7585aa5c-6bdc-41dc-8c41-7f019f0c2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad5d91e-9b87-4c4b-a2e3-5b63dd1fa591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ad5d91e-9b87-4c4b-a2e3-5b63dd1fa591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-450662925',display_name='tempest-VolumesGetTest-Volume-1237855005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c656aa87-d813-4028-adbc-1e08e86240af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:05Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afe061a-177e-4fda-833e-10283fa897c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4afe061a-177e-4fda-833e-10283fa897c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd21c86-f2d9-435a-92f5-ccff029e5012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd21c86-f2d9-435a-92f5-ccff029e5012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c656aa87-d813-4028-adbc-1e08e86240af', 'volume_name': 'volume-c656aa87-d813-4028-adbc-1e08e86240af', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eeb4b2c-c418-493e-bd03-b4404031f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eeb4b2c-c418-493e-bd03-b4404031f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04dd036-b684-45de-a1b4-3751d5ee5f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:05 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Volume c656aa87-d813-4028-adbc-1e08e86240af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c656aa87-d813-4028-adbc-1e08e86240af', 'volume_size': 1} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-450662925',display_name='tempest-VolumesGetTest-Volume-1237855005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c656aa87-d813-4028-adbc-1e08e86240af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:05Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Creating volume c656aa87-d813-4028-adbc-1e08e86240af {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:16:05 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:16:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:05 devstack sudo[110300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af 1073741824 Jun 26 22:16:05 devstack sudo[110300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:06 devstack sudo[110300]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af 1073741824" returned: 0 in 0.838s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:06 devstack sudo[110306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af Jun 26 22:16:06 devstack sudo[110306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:06 devstack sudo[110306]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af" returned: 0 in 0.654s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.538s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04dd036-b684-45de-a1b4-3751d5ee5f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c656aa87-d813-4028-adbc-1e08e86240af', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcabb66e-ffda-42d8-b017-dbf34353ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:06 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Volume volume-c656aa87-d813-4028-adbc-1e08e86240af (c656aa87-d813-4028-adbc-1e08e86240af): created successfully Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcabb66e-ffda-42d8-b017-dbf34353ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:06 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (7585aa5c-6bdc-41dc-8c41-7f019f0c2b35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:06 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0f30731a-c5a1-4d17-8aeb-8616a0f8f723 tempest-VolumesGetTest-1531496375 None] Created volume successfully. Jun 26 22:16:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-c656aa87-d813-4028-adbc-1e08e86240af-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Lock "cinder-c656aa87-d813-4028-adbc-1e08e86240af-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-c656aa87-d813-4028-adbc-1e08e86240af" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-c656aa87-d813-4028-adbc-1e08e86240af" acquired by "delete_volume" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:07 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe48809-c00d-4f4f-bc9f-ce0384176929]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:07 devstack sudo[110343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af Jun 26 22:16:07 devstack sudo[110343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:08 devstack sudo[110343]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af" returned: 0 in 0.837s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:08 devstack sudo[110351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af Jun 26 22:16:08 devstack sudo[110351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:08 devstack sudo[110351]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c656aa87-d813-4028-adbc-1e08e86240af" returned: 0 in 0.693s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-c656aa87-d813-4028-adbc-1e08e86240af" released by "delete_volume" :: held 1.581s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Created reservations ['d55d38ef-d786-490e-88e9-80e1045c06a3', '1cce2212-8e7d-428a-9973-05e274f664e3', '02f665b9-be66-4406-921e-bb22f586c696', 'a1ed14e2-a6ac-499b-bdfa-499e6108c41f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:09 devstack sudo[110354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:09 devstack sudo[110354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-accf88c0-f457-439a-9373-e2a7b1fb3c30-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Lock "cinder-accf88c0-f457-439a-9373-e2a7b1fb3c30-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-accf88c0-f457-439a-9373-e2a7b1fb3c30" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-accf88c0-f457-439a-9373-e2a7b1fb3c30" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c1648b-0897-44e9-856f-181070a89073]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:09 devstack sudo[110354]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.708s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Deleted volume successfully. Jun 26 22:16:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ef964acb-1305-4264-89ab-ab25c01f33a1 tempest-VolumesGetTest-1531496375 None] Lock "cinder-c656aa87-d813-4028-adbc-1e08e86240af-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:09 devstack sudo[110357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 Jun 26 22:16:09 devstack sudo[110357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:10 devstack sudo[110357]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30" returned: 0 in 0.777s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:10 devstack sudo[110362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30 Jun 26 22:16:10 devstack sudo[110362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:11 devstack sudo[110362]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-accf88c0-f457-439a-9373-e2a7b1fb3c30" returned: 0 in 0.630s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-accf88c0-f457-439a-9373-e2a7b1fb3c30" released by "delete_volume" :: held 1.457s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Created reservations ['6968171f-9d79-4434-8b56-6e5f9e9aaf05', '00b4bff8-fe83-4d1e-aff1-fd25a1653011', '9a7ae45a-7856-4307-932c-210a6eacae78', '4903c048-1b05-4d8c-b4c0-a031468146c6'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:11 devstack sudo[110372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:11 devstack sudo[110372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:11 devstack sudo[110372]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.628s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Deleted volume successfully. Jun 26 22:16:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2ff86039-df6c-46ad-bccb-4d3d769cad7d tempest-VolumesGetTest-1531496375 None] Lock "cinder-accf88c0-f457-439a-9373-e2a7b1fb3c30-delete_volume" released by "delete_volume" :: held 2.310s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=108,cinder:UPDATE=157,cinder:INSERT=43,cinder:DELETE=8 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=114,cinder:UPDATE=145,cinder:INSERT=38,cinder:DELETE=16 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (8452fffe-437a-4c43-8013-39ea0e6d85a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ab1ab6-9a40-4e44-ab55-e8ff7461a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ab1ab6-9a40-4e44-ab55-e8ff7461a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295352554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252041a4-823c-4b77-8bf5-7bb6f262a315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:12Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8d01e8-ab4c-4446-b5db-466395934eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d8d01e8-ab4c-4446-b5db-466395934eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a269911e-b098-4979-bff5-496b4ad4d001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a269911e-b098-4979-bff5-496b4ad4d001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '252041a4-823c-4b77-8bf5-7bb6f262a315', 'volume_name': 'volume-252041a4-823c-4b77-8bf5-7bb6f262a315', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d372cd3e-870a-41f2-a815-61a02797510f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d372cd3e-870a-41f2-a815-61a02797510f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506ebcab-6086-429e-905f-b23f3f4933f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Volume 252041a4-823c-4b77-8bf5-7bb6f262a315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-252041a4-823c-4b77-8bf5-7bb6f262a315', 'volume_size': 1} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1295352554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=252041a4-823c-4b77-8bf5-7bb6f262a315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:12Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Creating volume 252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:16:12 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:16:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:12 devstack sudo[110375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 1073741824 Jun 26 22:16:12 devstack sudo[110375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:13 devstack sudo[110375]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 1073741824" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:13 devstack sudo[110380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 Jun 26 22:16:13 devstack sudo[110380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:13 devstack sudo[110380]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315" returned: 0 in 0.684s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506ebcab-6086-429e-905f-b23f3f4933f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-252041a4-823c-4b77-8bf5-7bb6f262a315', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70696b2-3415-4d31-8742-de34a702aff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Volume volume-252041a4-823c-4b77-8bf5-7bb6f262a315 (252041a4-823c-4b77-8bf5-7bb6f262a315): created successfully Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b70696b2-3415-4d31-8742-de34a702aff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (8452fffe-437a-4c43-8013-39ea0e6d85a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6e234b4b-e253-4533-bea3-a76b78b2be4f tempest-VolumesGetTest-1531496375 None] Created volume successfully. Jun 26 22:16:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-4f1962b9-7c11-4398-bbcb-5c703f1ec17c req-7d185b0f-dfe6-4700-984a-aa63d33d6eaf tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-4f1962b9-7c11-4398-bbcb-5c703f1ec17c req-7d185b0f-dfe6-4700-984a-aa63d33d6eaf tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:14 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cef06c-fe72-41cf-aac8-a67f20c1da5a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-4f1962b9-7c11-4398-bbcb-5c703f1ec17c req-7d185b0f-dfe6-4700-984a-aa63d33d6eaf tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:14 devstack sudo[110391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 Jun 26 22:16:14 devstack sudo[110391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:14 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:16:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (d3248cc0-69c9-4316-a64a-b2dfd93dfd1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed2d8f5-a64c-421a-9f28-09ca0a1b0e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed2d8f5-a64c-421a-9f28-09ca0a1b0e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1884504565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d65c72e9-e846-46dd-832d-bcce71dbbf40,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=252041a4-823c-4b77-8bf5-7bb6f262a315,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:15Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900bc5d0-aad5-47a5-bea5-b65512492345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (900bc5d0-aad5-47a5-bea5-b65512492345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a0b876-47ee-4ef0-9433-59c48ebc5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53a0b876-47ee-4ef0-9433-59c48ebc5dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd65c72e9-e846-46dd-832d-bcce71dbbf40', 'volume_name': 'volume-d65c72e9-e846-46dd-832d-bcce71dbbf40', 'volume_size': 1, 'source_volid': '252041a4-823c-4b77-8bf5-7bb6f262a315', 'source_volstatus': 'available'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47ec265-9531-4574-929b-97fe0da45c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c47ec265-9531-4574-929b-97fe0da45c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6705f30-4a73-4975-8ed7-0fc7b6b2e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Volume d65c72e9-e846-46dd-832d-bcce71dbbf40: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d65c72e9-e846-46dd-832d-bcce71dbbf40', 'volume_size': 1, 'source_volid': '252041a4-823c-4b77-8bf5-7bb6f262a315', 'source_volstatus': 'available'} Jun 26 22:16:15 devstack sudo[110391]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-4f1962b9-7c11-4398-bbcb-5c703f1ec17c req-7d185b0f-dfe6-4700-984a-aa63d33d6eaf tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67" returned: 0 in 0.847s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-4f1962b9-7c11-4398-bbcb-5c703f1ec17c req-7d185b0f-dfe6-4700-984a-aa63d33d6eaf tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:15 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Cloning volume 252041a4-823c-4b77-8bf5-7bb6f262a315 to volume d65c72e9-e846-46dd-832d-bcce71dbbf40 Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Creating offline snapshot 0c3485a8-3e63-4768-a47c-a343956ac66c of volume 252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-4f1962b9-7c11-4398-bbcb-5c703f1ec17c req-7d185b0f-dfe6-4700-984a-aa63d33d6eaf tempest-TestInstancesWithCinderVolumes-602323859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-143c82d9-576b-4a28-8814-f9c58a216c67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd01a728c-5c38-4873-a83d-46af57d84d42', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4dd150-759a-4c72-8d13-c686d1dc0593]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-4f1962b9-7c11-4398-bbcb-5c703f1ec17c req-7d185b0f-dfe6-4700-984a-aa63d33d6eaf tempest-TestInstancesWithCinderVolumes-602323859 None] attachment_update completed successfully. Jun 26 22:16:15 devstack sudo[110397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 Jun 26 22:16:15 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:15 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315" returned: 0 in 0.799s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:15 devstack sudo[110402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c 1G Jun 26 22:16:15 devstack sudo[110402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:16 devstack sudo[110402]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c 1G" returned: 0 in 0.815s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252041a4-823c-4b77-8bf5-7bb6f262a315 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:16 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252041a4-823c-4b77-8bf5-7bb6f262a315 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c Jun 26 22:16:16 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:17 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-252041a4-823c-4b77-8bf5-7bb6f262a315 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c" returned: 0 in 0.718s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:17 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c is being set with open permissions: ugo+rw Jun 26 22:16:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:17 devstack sudo[110419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c Jun 26 22:16:17 devstack sudo[110419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:18 devstack sudo[110419]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c" returned: 0 in 0.672s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:18 devstack sudo[110422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.info Jun 26 22:16:18 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:18 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.info" returned: 0 in 0.632s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:18 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.info is being set with open permissions: ugo+rw Jun 26 22:16:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:18 devstack sudo[110425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.info Jun 26 22:16:18 devstack sudo[110425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:19 devstack sudo[110425]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.info" returned: 0 in 0.675s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-d65c72e9-e846-46dd-832d-bcce71dbbf40" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-d65c72e9-e846-46dd-832d-bcce71dbbf40" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] snapshot: 0c3485a8-3e63-4768-a47c-a343956ac66c, volume: d65c72e9-e846-46dd-832d-bcce71dbbf40, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9ba769-0db9-469b-bff4-6835dc004666]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:19 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c Jun 26 22:16:19 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:20 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c" returned: 0 in 0.882s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252041a4-823c-4b77-8bf5-7bb6f262a315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:16:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:16:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:16:20 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739c1e3-9803-4ef5-808c-09a7eeb71b05]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:20 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 Jun 26 22:16:20 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:21 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315" returned: 0 in 0.992s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:21 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:16:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:21 devstack sudo[110454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 Jun 26 22:16:21 devstack sudo[110454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-980d52ff-489c-4111-9500-d80db0a46777 req-656cec66-82ec-4305-8895-7ad061dbf65f tempest-TestMinimumBasicScenario-736625124 None] Terminate volume connection completed successfully. Jun 26 22:16:24 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-980d52ff-489c-4111-9500-d80db0a46777 req-656cec66-82ec-4305-8895-7ad061dbf65f tempest-TestMinimumBasicScenario-736625124 None] Deleting attachment 75683834-9c11-42ee-a503-f6f7dd3f1ab8. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:16:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-e75a80b8-e978-491f-a5c1-cc5fc77e0683 req-51c17c03-e25b-4f44-a223-57ca805fa9c3 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Acquiring lock "cinder-3f29b8b0-7a46-4e6d-97b6-698c4acf9556-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Lock "cinder-3f29b8b0-7a46-4e6d-97b6-698c4acf9556-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Acquiring lock "cinder-quobyte-3f29b8b0-7a46-4e6d-97b6-698c4acf9556" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Lock "cinder-quobyte-3f29b8b0-7a46-4e6d-97b6-698c4acf9556" acquired by "delete_volume" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb0c83ae-febe-48c1-a438-07f4894e1dfe]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:26 devstack sudo[110493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 Jun 26 22:16:26 devstack sudo[110493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:27 devstack sudo[110454]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40" returned: 0 in 5.869s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:27 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b13067-87ef-43e9-a853-0d33339fe610]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:27 devstack sudo[110495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 Jun 26 22:16:27 devstack sudo[110495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:27 devstack sudo[110493]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556" returned: 0 in 1.142s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:27 devstack sudo[110501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556 Jun 26 22:16:27 devstack sudo[110501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:28 devstack sudo[110495]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315" returned: 0 in 0.942s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315, size 1024.00 MB, duration 5.87 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:16:28 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Converted 1024.00 MB image at 174.42 MB/s Jun 26 22:16:28 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 is being set with open permissions: ugo+rw Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:28 devstack sudo[110501]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3f29b8b0-7a46-4e6d-97b6-698c4acf9556" returned: 0 in 0.670s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:28 devstack sudo[110507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 Jun 26 22:16:28 devstack sudo[110507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Lock "cinder-quobyte-3f29b8b0-7a46-4e6d-97b6-698c4acf9556" released by "delete_volume" :: held 1.904s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Created reservations ['b77a4cc5-b69e-457e-8525-007a2a07ce3a', '8fded59b-634d-41c4-ac80-6cabcd3db864', '611bbc51-9c5b-4604-8fb2-31e2c2a6c09e', '16366529-7526-49b9-a92d-a3f7ed2013fc'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:28 devstack sudo[110509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:28 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:28 devstack sudo[110507]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40" returned: 0 in 0.633s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-d65c72e9-e846-46dd-832d-bcce71dbbf40" released by "_copy_volume_from_snapshot" :: held 9.427s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-0c3485a8-3e63-4768-a47c-a343956ac66c" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-0c3485a8-3e63-4768-a47c-a343956ac66c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Deleting offline snapshot 0c3485a8-3e63-4768-a47c-a343956ac66c of volume 252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] snapshot_file for this snap is: volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fd4159-313f-4e5e-97a0-dcfdc66a3ef4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:29 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.692s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Deleted volume successfully. Jun 26 22:16:29 devstack sudo[110512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c Jun 26 22:16:29 devstack sudo[110512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6f3c620-3952-465a-b612-aa83c0cde9e8 tempest-TestMinimumBasicScenario-736625124 None] Lock "cinder-3f29b8b0-7a46-4e6d-97b6-698c4acf9556-delete_volume" released by "delete_volume" :: held 2.879s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:29 devstack sudo[110512]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c" returned: 0 in 0.843s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-252041a4-823c-4b77-8bf5-7bb6f262a315(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b515f7e-292e-470a-b456-07c70ebecd73]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:30 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 Jun 26 22:16:30 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:30 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315" returned: 0 in 0.978s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:30 devstack sudo[110563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c Jun 26 22:16:30 devstack sudo[110563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:31 devstack sudo[110563]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c" returned: 0 in 0.820s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:31 devstack sudo[110570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c Jun 26 22:16:31 devstack sudo[110570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:32 devstack sudo[110570]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315.0c3485a8-3e63-4768-a47c-a343956ac66c" returned: 0 in 0.735s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-0c3485a8-3e63-4768-a47c-a343956ac66c" released by "_delete_snapshot" :: held 3.525s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.464s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-e75a80b8-e978-491f-a5c1-cc5fc77e0683 req-51c17c03-e25b-4f44-a223-57ca805fa9c3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.160s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6705f30-4a73-4975-8ed7-0fc7b6b2e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d65c72e9-e846-46dd-832d-bcce71dbbf40', 'volume_size': 1, 'source_volid': '252041a4-823c-4b77-8bf5-7bb6f262a315', 'source_volstatus': 'available'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f185b54-47dd-470b-ab41-a52b56af92f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[24df363c-f696-4359-a614-70a50ea1c8c6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-e75a80b8-e978-491f-a5c1-cc5fc77e0683 req-51c17c03-e25b-4f44-a223-57ca805fa9c3 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Volume volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 (d65c72e9-e846-46dd-832d-bcce71dbbf40): created successfully Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f185b54-47dd-470b-ab41-a52b56af92f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (d3248cc0-69c9-4316-a64a-b2dfd93dfd1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:32 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fc2a5225-df22-4b67-b2ae-92b9df0a68ed tempest-VolumesGetTest-1531496375 None] Created volume successfully. Jun 26 22:16:32 devstack sudo[110574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 Jun 26 22:16:32 devstack sudo[110574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:33 devstack sudo[110574]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-e75a80b8-e978-491f-a5c1-cc5fc77e0683 req-51c17c03-e25b-4f44-a223-57ca805fa9c3 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06" returned: 0 in 0.833s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-e75a80b8-e978-491f-a5c1-cc5fc77e0683 req-51c17c03-e25b-4f44-a223-57ca805fa9c3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-e75a80b8-e978-491f-a5c1-cc5fc77e0683 req-51c17c03-e25b-4f44-a223-57ca805fa9c3 tempest-TestInstancesWithCinderVolumes-602323859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3527f7f8-a3f8-49fc-838e-599d3a0d2ba5', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:16:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-e75a80b8-e978-491f-a5c1-cc5fc77e0683 req-51c17c03-e25b-4f44-a223-57ca805fa9c3 tempest-TestInstancesWithCinderVolumes-602323859 None] attachment_update completed successfully. Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (4167900f-599a-4a49-86ad-43e846a26fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa8553e-99a7-4894-84d0-d9c8db83afd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1aa8553e-99a7-4894-84d0-d9c8db83afd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-850684117',display_name='tempest-VolumesGetTest-Volume-1991812276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196cdbbc-d902-4404-ad6e-30083d22bbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:34Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0f7d27-22af-40a6-bae6-6fc0a620759e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b0f7d27-22af-40a6-bae6-6fc0a620759e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2dfe43-a46b-4f9c-9667-a8ef2fd4cc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d2dfe43-a46b-4f9c-9667-a8ef2fd4cc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196cdbbc-d902-4404-ad6e-30083d22bbc0', 'volume_name': 'volume-196cdbbc-d902-4404-ad6e-30083d22bbc0', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351d063-0410-41e6-8ee2-153e232c2339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d351d063-0410-41e6-8ee2-153e232c2339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a1c94e-3765-467d-ad29-d8f289963004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:34 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Volume 196cdbbc-d902-4404-ad6e-30083d22bbc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196cdbbc-d902-4404-ad6e-30083d22bbc0', 'volume_size': 1} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:34Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-850684117',display_name='tempest-VolumesGetTest-Volume-1991812276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196cdbbc-d902-4404-ad6e-30083d22bbc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:34Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Creating volume 196cdbbc-d902-4404-ad6e-30083d22bbc0 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:16:34 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:16:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:34 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 1073741824 Jun 26 22:16:34 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:35 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 1073741824" returned: 0 in 0.921s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:35 devstack sudo[110592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 Jun 26 22:16:35 devstack sudo[110592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:35 devstack sudo[110592]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0" returned: 0 in 0.656s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3a1c94e-3765-467d-ad29-d8f289963004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196cdbbc-d902-4404-ad6e-30083d22bbc0', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ea42ae-5251-4838-b78b-77da59978f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:35 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Volume volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 (196cdbbc-d902-4404-ad6e-30083d22bbc0): created successfully Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ea42ae-5251-4838-b78b-77da59978f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (4167900f-599a-4a49-86ad-43e846a26fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-70213ab6-2891-4d5f-8fb6-3b80fbcaf6e8 tempest-VolumesGetTest-1531496375 None] Created volume successfully. Jun 26 22:16:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-196cdbbc-d902-4404-ad6e-30083d22bbc0-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Lock "cinder-196cdbbc-d902-4404-ad6e-30083d22bbc0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-196cdbbc-d902-4404-ad6e-30083d22bbc0" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-196cdbbc-d902-4404-ad6e-30083d22bbc0" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6a586a-16e5-4df8-8e27-eca8fb68c180]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:36 devstack sudo[110595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 Jun 26 22:16:36 devstack sudo[110595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:37 devstack sudo[110595]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0" returned: 0 in 0.892s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:37 devstack sudo[110600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0 Jun 26 22:16:37 devstack sudo[110600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:38 devstack sudo[110600]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-196cdbbc-d902-4404-ad6e-30083d22bbc0" returned: 0 in 0.708s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-196cdbbc-d902-4404-ad6e-30083d22bbc0" released by "delete_volume" :: held 1.653s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Created reservations ['eb2c1380-15ff-409b-bce2-d198e7262c69', '35a99e98-b0fe-42f3-9d9d-fed34771aa14', '590897c1-f99b-4b10-af4e-a1dcccab7cdc', '8748530f-554e-4411-a254-e5668e98db3f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:38 devstack sudo[110612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:38 devstack sudo[110612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-d65c72e9-e846-46dd-832d-bcce71dbbf40-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Lock "cinder-d65c72e9-e846-46dd-832d-bcce71dbbf40-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-d65c72e9-e846-46dd-832d-bcce71dbbf40" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-d65c72e9-e846-46dd-832d-bcce71dbbf40" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb57494-2ec1-42ff-81e7-e63a68453c14]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:39 devstack sudo[110614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 Jun 26 22:16:39 devstack sudo[110614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:39 devstack sudo[110612]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.755s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:39 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Deleted volume successfully. Jun 26 22:16:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a8aaede0-a208-492c-b16f-baec696d15d0 tempest-VolumesGetTest-1531496375 None] Lock "cinder-196cdbbc-d902-4404-ad6e-30083d22bbc0-delete_volume" released by "delete_volume" :: held 2.681s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:40 devstack sudo[110614]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40" returned: 0 in 1.038s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:40 devstack sudo[110620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40 Jun 26 22:16:40 devstack sudo[110620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:40 devstack sudo[110620]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d65c72e9-e846-46dd-832d-bcce71dbbf40" returned: 0 in 0.783s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-d65c72e9-e846-46dd-832d-bcce71dbbf40" released by "delete_volume" :: held 1.892s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:40 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Created reservations ['c08b4f89-faac-4c52-81e4-de096acfc251', '21a17708-8f62-4589-b92b-947bc469b679', 'ac8a866b-406f-4bcd-8e97-12f1f68fdc9b', 'a5da1cb9-fa75-4673-94a1-758bcfb3f01a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:41 devstack sudo[110635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:41 devstack sudo[110635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-252041a4-823c-4b77-8bf5-7bb6f262a315-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Lock "cinder-252041a4-823c-4b77-8bf5-7bb6f262a315-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-252041a4-823c-4b77-8bf5-7bb6f262a315" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-252041a4-823c-4b77-8bf5-7bb6f262a315" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[af53a37d-e060-499e-84d8-4ff2bc4aa8b0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:41 devstack sudo[110641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 Jun 26 22:16:41 devstack sudo[110641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:41 devstack sudo[110635]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.880s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:41 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Deleted volume successfully. Jun 26 22:16:41 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b482503e-bc67-4fbb-98c7-2890ccfe335b tempest-VolumesGetTest-1531496375 None] Lock "cinder-d65c72e9-e846-46dd-832d-bcce71dbbf40-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:42 devstack sudo[110641]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315" returned: 0 in 0.925s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:42 devstack sudo[110655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315 Jun 26 22:16:42 devstack sudo[110655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:42 devstack sudo[110655]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-252041a4-823c-4b77-8bf5-7bb6f262a315" returned: 0 in 0.678s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-252041a4-823c-4b77-8bf5-7bb6f262a315" released by "delete_volume" :: held 1.680s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Created reservations ['cbf69aa2-8a1d-4454-8283-228ae692dcc0', 'c7eafb47-0d99-4779-b711-2b2ee7723439', 'ee346828-41ff-43b3-ac3e-ed82a736de5a', '2ff65f42-04f7-4f7f-8cfe-3745c3d70ede'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:43 devstack sudo[110659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:43 devstack sudo[110659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-40f0abb0-afc3-4754-a424-4e4579af8668 req-0bc79879-bf95-47f6-aa8f-920d62cb734c tempest-TestInstancesWithCinderVolumes-602323859 None] Terminate volume connection completed successfully. Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-40f0abb0-afc3-4754-a424-4e4579af8668 req-0bc79879-bf95-47f6-aa8f-920d62cb734c tempest-TestInstancesWithCinderVolumes-602323859 None] Deleting attachment d01a728c-5c38-4873-a83d-46af57d84d42. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:16:43 devstack sudo[110659]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.872s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:43 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Deleted volume successfully. Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a01fd0aa-8c9e-4f9c-b753-06f553e60920 tempest-VolumesGetTest-1531496375 None] Lock "cinder-252041a4-823c-4b77-8bf5-7bb6f262a315-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (623b70c4-d1a9-4909-a540-047194c032af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b29765-1835-4c96-a236-c52f918af4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b29765-1835-4c96-a236-c52f918af4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1107653787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7650fa-8271-41f8-b613-f2b10f2426ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:44Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023c95b3-886c-4ffa-81b9-41e3cebcf948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (023c95b3-886c-4ffa-81b9-41e3cebcf948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa545422-4be4-428f-b13f-feb15f6f3d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:44 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa545422-4be4-428f-b13f-feb15f6f3d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d7650fa-8271-41f8-b613-f2b10f2426ab', 'volume_name': 'volume-8d7650fa-8271-41f8-b613-f2b10f2426ab', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d109c7-a88c-4ece-8eb8-12e45b8270f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d109c7-a88c-4ece-8eb8-12e45b8270f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196c9050-3fb9-40f4-83f0-1ae077bd714e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:45 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Volume 8d7650fa-8271-41f8-b613-f2b10f2426ab: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d7650fa-8271-41f8-b613-f2b10f2426ab', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Trying to clone 8d7650fa-8271-41f8-b613-f2b10f2426ab from image 57efc2e5-cc7c-4583-b444-d036b0944149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:16:45 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Image download 20.69 MB at 20.69 MB/s Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d269d0-918b-4452-8f38-d8b957fec144]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "cinder-143c82d9-576b-4a28-8814-f9c58a216c67-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-143c82d9-576b-4a28-8814-f9c58a216c67-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "cinder-quobyte-143c82d9-576b-4a28-8814-f9c58a216c67" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-quobyte-143c82d9-576b-4a28-8814-f9c58a216c67" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:45 devstack sudo[110676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD Jun 26 22:16:45 devstack sudo[110676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99aa203-c909-4ec6-908c-65b7b45500b7]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:45 devstack sudo[110682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 Jun 26 22:16:45 devstack sudo[110682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:46 devstack sudo[110689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:46 devstack sudo[110689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:46 devstack sudo[110676]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD" returned: 0 in 0.950s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 is fetched for user 50ba4d1b57b74d45aa1a7c2ab9f5c407. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[85203a4e-b7ac-40e8-9a9a-eee07710a2aa]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:46 devstack sudo[110682]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67" returned: 0 in 0.952s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:46 devstack sudo[110693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67 Jun 26 22:16:46 devstack sudo[110693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:46 devstack sudo[110692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD Jun 26 22:16:46 devstack sudo[110692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:47 devstack sudo[110689]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.911s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:16:47 devstack sudo[110693]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-143c82d9-576b-4a28-8814-f9c58a216c67" returned: 0 in 0.898s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-quobyte-143c82d9-576b-4a28-8814-f9c58a216c67" released by "delete_volume" :: held 1.916s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:47 devstack cinder-volume[93616]: WARNING cinder.quota [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295447929-312594662 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295447929-312594662, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:16:47 devstack cinder-volume[93616]: WARNING cinder.quota [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295447929-312594662 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-295447929-312594662, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Created reservations ['8e9fb2f3-d98d-44de-ab38-d323f1ea5309', 'dba32ea7-ee8b-47cc-a79e-695ea5ee74e0', '13979c20-c7ad-4c96-b809-61839a1eca8d', '5b5ad0ed-2177-447a-971a-38ac6b72a2f6'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:47 devstack sudo[110692]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD" returned: 0 in 1.115s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1107653787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7650fa-8271-41f8-b613-f2b10f2426ab,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:44Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Creating volume 8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:16:47 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:16:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:47 devstack sudo[110702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:47 devstack sudo[110702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:47 devstack sudo[110704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab 1073741824 Jun 26 22:16:47 devstack sudo[110704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:48 devstack sudo[110702]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.678s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:48 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Deleted volume successfully. Jun 26 22:16:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0f197ab2-98bf-4cfd-8749-9251314c589a tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-143c82d9-576b-4a28-8814-f9c58a216c67-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:48 devstack sudo[110704]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab 1073741824" returned: 0 in 0.886s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:48 devstack sudo[110727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab Jun 26 22:16:48 devstack sudo[110727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:49 devstack sudo[110727]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab" returned: 0 in 0.649s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:49 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:16:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:49 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Attempting download of 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume 8d7650fa-8271-41f8-b613-f2b10f2426ab. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:16:49 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9809376f-b17a-45a1-a9b6-9c2ccd5a421f]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_u4fnysem {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:49 devstack sudo[110734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_u4fnysem Jun 26 22:16:49 devstack sudo[110734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:50 devstack sudo[110734]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_u4fnysem" returned: 0 in 0.718s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_u4fnysem {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:50 devstack sudo[110738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_u4fnysem Jun 26 22:16:50 devstack sudo[110738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:50 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-9ecb3be7-cad6-4f15-a772-bb566db52d4c req-715d8720-eb0e-47ca-a0ae-f77eeb61b4fc tempest-TestInstancesWithCinderVolumes-602323859 None] Terminate volume connection completed successfully. Jun 26 22:16:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-9ecb3be7-cad6-4f15-a772-bb566db52d4c req-715d8720-eb0e-47ca-a0ae-f77eeb61b4fc tempest-TestInstancesWithCinderVolumes-602323859 None] Deleting attachment 3527f7f8-a3f8-49fc-838e-599d3a0d2ba5. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:16:51 devstack sudo[110738]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_u4fnysem" returned: 1 in 0.764s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_u4fnysem' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:16:51 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c224ad6b-26dc-4c35-82f1-2f9339a7ba12]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:51 devstack sudo[110747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD Jun 26 22:16:51 devstack sudo[110747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:51 devstack sudo[110747]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD" returned: 0 in 0.707s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:51 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] 57efc2e5-cc7c-4583-b444-d036b0944149 was qcow2, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:16:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:51 devstack sudo[110752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab Jun 26 22:16:51 devstack sudo[110752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "cinder-c71965f5-b0e9-4a95-ad77-51b8e1beea06-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-c71965f5-b0e9-4a95-ad77-51b8e1beea06-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "cinder-quobyte-c71965f5-b0e9-4a95-ad77-51b8e1beea06" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:16:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-quobyte-c71965f5-b0e9-4a95-ad77-51b8e1beea06" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:16:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4ab32a-b22f-4db6-a2c3-abae65bce6d4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:52 devstack sudo[110763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 Jun 26 22:16:52 devstack sudo[110763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:53 devstack sudo[110763]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06" returned: 0 in 0.950s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:53 devstack sudo[110768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06 Jun 26 22:16:53 devstack sudo[110768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:53 devstack sudo[110752]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab" returned: 0 in 2.090s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:53 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_mymbho0pdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:16:53 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Converted 112.00 MB image at 53.51 MB/s Jun 26 22:16:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:53 devstack sudo[110771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab 1G Jun 26 22:16:53 devstack sudo[110771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:54 devstack sudo[110768]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-c71965f5-b0e9-4a95-ad77-51b8e1beea06" returned: 0 in 0.762s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-quobyte-c71965f5-b0e9-4a95-ad77-51b8e1beea06" released by "delete_volume" :: held 1.756s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:54 devstack cinder-volume[93616]: WARNING cinder.quota [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388239570-1281265280 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388239570-1281265280, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:16:54 devstack cinder-volume[93616]: WARNING cinder.quota [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388239570-1281265280 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-388239570-1281265280, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Created reservations ['dfe9eff9-95cc-4a1f-9eb4-afcf8b3f5e14', '335b5f69-79d5-4bc8-9e66-b49f44a1cfa4', 'e4d84ac9-ac52-40e5-b623-a0042ccd6dc3', '74bef38c-53e5-40a1-bbd7-9b3452c472ae'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:54 devstack sudo[110774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:16:54 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:54 devstack sudo[110771]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab 1G" returned: 0 in 0.884s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed54e4fb-6c05-4343-9503-fbbf956482a3]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:16:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:55 devstack sudo[110780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab Jun 26 22:16:55 devstack sudo[110780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:55 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.774s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:55 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:16:55 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Deleted volume successfully. Jun 26 22:16:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f8e126df-a571-4098-8aa4-d59c721b99b3 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-c71965f5-b0e9-4a95-ad77-51b8e1beea06-delete_volume" released by "delete_volume" :: held 2.796s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:16:55 devstack sudo[110780]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab" returned: 0 in 0.884s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:55 devstack sudo[110787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab Jun 26 22:16:55 devstack sudo[110787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:56 devstack sudo[110787]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab" returned: 1 in 0.834s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Downloaded image 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume 8d7650fa-8271-41f8-b613-f2b10f2426ab successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 for user 50ba4d1b57b74d45aa1a7c2ab9f5c407 is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Marking volume 8d7650fa-8271-41f8-b613-f2b10f2426ab as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Copying metadata from image 57efc2e5-cc7c-4583-b444-d036b0944149 to 8d7650fa-8271-41f8-b613-f2b10f2426ab. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Creating volume glance metadata for volume 8d7650fa-8271-41f8-b613-f2b10f2426ab backed by image 57efc2e5-cc7c-4583-b444-d036b0944149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (196c9050-3fb9-40f4-83f0-1ae077bd714e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d7650fa-8271-41f8-b613-f2b10f2426ab', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2218505-7bfa-4a2f-a620-1b4b225368f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Volume volume-8d7650fa-8271-41f8-b613-f2b10f2426ab (8d7650fa-8271-41f8-b613-f2b10f2426ab): created successfully Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2218505-7bfa-4a2f-a620-1b4b225368f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (623b70c4-d1a9-4909-a540-047194c032af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-61c89e54-54be-4517-8037-a6357de5ca08 tempest-VolumesGetTest-1531496375 None] Created volume successfully. Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (199a1b97-3b1f-4495-83a6-ed0658fc5a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c592849c-98ca-4327-a03d-c750563b1313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c592849c-98ca-4327-a03d-c750563b1313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1479226459',display_name='tempest-VolumesGetTest-Volume-1633719629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b14c34-8d90-497c-8250-edebaefe67e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:58Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd06ac9e-7c93-4d8f-a4b7-1de80c9151eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd06ac9e-7c93-4d8f-a4b7-1de80c9151eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9991ddbc-bc09-4332-b75e-1ec77e2a99f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9991ddbc-bc09-4332-b75e-1ec77e2a99f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23b14c34-8d90-497c-8250-edebaefe67e6', 'volume_name': 'volume-23b14c34-8d90-497c-8250-edebaefe67e6', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65e91dc-64f1-4058-8900-0f71c2488642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65e91dc-64f1-4058-8900-0f71c2488642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4636b353-c034-449a-9e2b-df6beda9a8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:58 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Volume 23b14c34-8d90-497c-8250-edebaefe67e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23b14c34-8d90-497c-8250-edebaefe67e6', 'volume_size': 1} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:16:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1479226459',display_name='tempest-VolumesGetTest-Volume-1633719629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23b14c34-8d90-497c-8250-edebaefe67e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d50ef19abccb4b97bca18ede4b73049c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:16:58Z,use_quota=True,user_id='50ba4d1b57b74d45aa1a7c2ab9f5c407',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Creating volume 23b14c34-8d90-497c-8250-edebaefe67e6 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:16:58 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:16:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:58 devstack sudo[110832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 1073741824 Jun 26 22:16:58 devstack sudo[110832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:59 devstack sudo[110832]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 1073741824" returned: 0 in 1.004s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:16:59 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 Jun 26 22:16:59 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:16:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-1e981701-20dd-4b53-b763-d91a681f22b4 req-a2efecf4-2128-4539-8544-f4f56fed0a00 tempest-TestInstancesWithCinderVolumes-602323859 None] Terminate volume connection completed successfully. Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-1e981701-20dd-4b53-b763-d91a681f22b4 req-a2efecf4-2128-4539-8544-f4f56fed0a00 tempest-TestInstancesWithCinderVolumes-602323859 None] Deleting attachment a5cd4072-3a17-43ae-b305-e98a3f01ee02. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:16:59 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6" returned: 0 in 0.671s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.724s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4636b353-c034-449a-9e2b-df6beda9a8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23b14c34-8d90-497c-8250-edebaefe67e6', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9036ae6-71ef-45af-a306-7db8edbd6fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:16:59 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Volume volume-23b14c34-8d90-497c-8250-edebaefe67e6 (23b14c34-8d90-497c-8250-edebaefe67e6): created successfully Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9036ae6-71ef-45af-a306-7db8edbd6fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:16:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Flow 'volume_create_manager' (199a1b97-3b1f-4495-83a6-ed0658fc5a8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:16:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1b649cbe-f832-4034-8747-3867c523d47c tempest-VolumesGetTest-1531496375 None] Created volume successfully. Jun 26 22:17:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-23b14c34-8d90-497c-8250-edebaefe67e6-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Lock "cinder-23b14c34-8d90-497c-8250-edebaefe67e6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-23b14c34-8d90-497c-8250-edebaefe67e6" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-23b14c34-8d90-497c-8250-edebaefe67e6" acquired by "delete_volume" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:00 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7208b8d-991b-43eb-b6c3-143182670fef]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:00 devstack sudo[110842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 Jun 26 22:17:00 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:01 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6" returned: 0 in 0.770s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:01 devstack sudo[110847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6 Jun 26 22:17:01 devstack sudo[110847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:01 devstack sudo[110847]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-23b14c34-8d90-497c-8250-edebaefe67e6" returned: 0 in 0.691s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-23b14c34-8d90-497c-8250-edebaefe67e6" released by "delete_volume" :: held 1.505s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Created reservations ['9628c58d-3f1e-49f4-ab99-90d543822d92', '1203eff9-405e-4536-83d8-3ac15dd097ff', '2a5064b2-8ae0-4e9f-b596-f7f4ef3cff3b', '2f55b689-fd39-4c11-a74f-a74859f55684'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:01 devstack sudo[110853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:17:01 devstack sudo[110853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-8d7650fa-8271-41f8-b613-f2b10f2426ab-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:02 devstack sudo[110853]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.631s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Lock "cinder-8d7650fa-8271-41f8-b613-f2b10f2426ab-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:02 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Deleted volume successfully. Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b6d8329a-1a74-4eee-99e9-6ff3de2883c5 tempest-VolumesGetTest-1531496375 None] Lock "cinder-23b14c34-8d90-497c-8250-edebaefe67e6-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Acquiring lock "cinder-quobyte-8d7650fa-8271-41f8-b613-f2b10f2426ab" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-8d7650fa-8271-41f8-b613-f2b10f2426ab" acquired by "delete_volume" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2202dc2-dc20-448d-8afc-1204a1002b05]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "cinder-55ab2c4b-2388-4819-9158-3c1cc7b51314-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:02 devstack sudo[110856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab Jun 26 22:17:02 devstack sudo[110856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-55ab2c4b-2388-4819-9158-3c1cc7b51314-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "cinder-quobyte-55ab2c4b-2388-4819-9158-3c1cc7b51314" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-quobyte-55ab2c4b-2388-4819-9158-3c1cc7b51314" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b4f17a-e6c0-4ed5-9ca5-2afa1f1e6c0b]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:03 devstack sudo[110858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:17:03 devstack sudo[110858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:03 devstack sudo[110856]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab" returned: 0 in 0.820s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:03 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab Jun 26 22:17:03 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:03 devstack sudo[110858]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 0 in 0.819s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:03 devstack sudo[110866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:17:03 devstack sudo[110866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:04 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab" returned: 1 in 0.803s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:04 devstack sudo[110871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab Jun 26 22:17:04 devstack sudo[110871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:04 devstack sudo[110866]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 1 in 0.806s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:04 devstack sudo[110876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314 Jun 26 22:17:04 devstack sudo[110876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:04 devstack sudo[110871]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8d7650fa-8271-41f8-b613-f2b10f2426ab" returned: 0 in 0.628s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Lock "cinder-quobyte-8d7650fa-8271-41f8-b613-f2b10f2426ab" released by "delete_volume" :: held 2.334s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Created reservations ['0c3fa7c3-c92d-4c70-9508-f54fd8fa08d0', '8ffd75cd-e162-445a-a302-acbf5ba08e45', '42f77050-58ac-49dd-aa3b-fa92442638c2', '3aa87bd2-8024-464f-b70b-a9ddb46acf37'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:05 devstack sudo[110881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:17:05 devstack sudo[110881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:05 devstack sudo[110876]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-55ab2c4b-2388-4819-9158-3c1cc7b51314" returned: 0 in 0.686s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-quobyte-55ab2c4b-2388-4819-9158-3c1cc7b51314" released by "delete_volume" :: held 2.390s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:05 devstack cinder-volume[93616]: WARNING cinder.quota [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1067833826-1593068734 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1067833826-1593068734, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:17:05 devstack cinder-volume[93616]: WARNING cinder.quota [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1067833826-1593068734 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1067833826-1593068734, it is now deprecated. Please use the default quota class for default quota. Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Created reservations ['47b7b305-2471-4dd3-a815-ca82b065fed2', '8f8ccf3b-86f7-4b6f-81a3-8a16b102ede7', '18f9d867-0654-43c3-9d77-affe2dc84682', '8d961ada-ad2c-487a-9974-8f5f9d38f686'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:05 devstack sudo[110883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:17:05 devstack sudo[110883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:05 devstack sudo[110881]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.703s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:17:05 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Deleted volume successfully. Jun 26 22:17:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-635869b8-cc99-45d5-8655-ae4dad6d6916 tempest-VolumesGetTest-1531496375 None] Lock "cinder-8d7650fa-8271-41f8-b613-f2b10f2426ab-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:06 devstack sudo[110883]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.671s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:06 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:17:06 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Deleted volume successfully. Jun 26 22:17:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2e235920-21d4-4cb4-885a-fa00dccabb64 tempest-TestInstancesWithCinderVolumes-602323859 None] Lock "cinder-55ab2c4b-2388-4819-9158-3c1cc7b51314-delete_volume" released by "delete_volume" :: held 3.285s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:08 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Flow 'volume_create_manager' (ee157456-828d-45fb-9f82-948d01a08a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c9bdde-bac9-4219-90b7-1866d25acd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26c9bdde-bac9-4219-90b7-1866d25acd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-219506952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f08dd09-a353-49b8-89b0-8865ceaa0384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35aa119edfc8482787a83ddd545b3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:09Z,use_quota=True,user_id='8598f840ccaf4d4785365c24a571db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7850ccd6-769f-4b2d-a848-8994548e4e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7850ccd6-769f-4b2d-a848-8994548e4e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841397f8-bf68-4eda-9f19-7fbb144478cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841397f8-bf68-4eda-9f19-7fbb144478cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f08dd09-a353-49b8-89b0-8865ceaa0384', 'volume_name': 'volume-4f08dd09-a353-49b8-89b0-8865ceaa0384', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afacbc7e-40da-4cb9-951d-cc4574f3f79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afacbc7e-40da-4cb9-951d-cc4574f3f79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a7073b-f3e2-404c-8ade-353076633c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:09 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Volume 4f08dd09-a353-49b8-89b0-8865ceaa0384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f08dd09-a353-49b8-89b0-8865ceaa0384', 'volume_size': 1} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-219506952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f08dd09-a353-49b8-89b0-8865ceaa0384,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35aa119edfc8482787a83ddd545b3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:09Z,use_quota=True,user_id='8598f840ccaf4d4785365c24a571db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Creating volume 4f08dd09-a353-49b8-89b0-8865ceaa0384 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:17:09 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:09 devstack sudo[110924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 1073741824 Jun 26 22:17:09 devstack sudo[110924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:09 devstack sudo[110924]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 1073741824" returned: 0 in 0.886s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:10 devstack sudo[110930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 Jun 26 22:17:10 devstack sudo[110930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:10 devstack sudo[110930]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384" returned: 0 in 0.696s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a7073b-f3e2-404c-8ade-353076633c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f08dd09-a353-49b8-89b0-8865ceaa0384', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42635abc-20da-4dba-bc60-33a02d132fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:10 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Volume volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 (4f08dd09-a353-49b8-89b0-8865ceaa0384): created successfully Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42635abc-20da-4dba-bc60-33a02d132fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Flow 'volume_create_manager' (ee157456-828d-45fb-9f82-948d01a08a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bbacdddd-3c99-4884-a051-f436aafe8f00 tempest-VolumesListTestJSON-1534146630 None] Created volume successfully. Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Flow 'volume_create_manager' (3c5b09d8-659d-4bec-ab98-3ed4674e73de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c11c346-82a3-42ab-9475-880cf891adfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c11c346-82a3-42ab-9475-880cf891adfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1003681665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585e66a6-ebc2-4cc7-a3e5-8fe942127257,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35aa119edfc8482787a83ddd545b3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:12Z,use_quota=True,user_id='8598f840ccaf4d4785365c24a571db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f79220-824f-49b8-9cd4-78b923f40355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f79220-824f-49b8-9cd4-78b923f40355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d332d73-30dc-49a7-8f6c-a9cd8ad6d0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d332d73-30dc-49a7-8f6c-a9cd8ad6d0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '585e66a6-ebc2-4cc7-a3e5-8fe942127257', 'volume_name': 'volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07242a25-86c7-4c3f-8104-0bc2c3f54cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07242a25-86c7-4c3f-8104-0bc2c3f54cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ed5921-ac02-45b8-b898-fa06dc332812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:11 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Volume 585e66a6-ebc2-4cc7-a3e5-8fe942127257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257', 'volume_size': 1} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1003681665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=585e66a6-ebc2-4cc7-a3e5-8fe942127257,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35aa119edfc8482787a83ddd545b3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:12Z,use_quota=True,user_id='8598f840ccaf4d4785365c24a571db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Creating volume 585e66a6-ebc2-4cc7-a3e5-8fe942127257 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:17:11 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:17:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:11 devstack sudo[110934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 1073741824 Jun 26 22:17:11 devstack sudo[110934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:12 devstack sudo[110934]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 1073741824" returned: 0 in 0.884s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:12 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=82,cinder:INSERT=28,cinder:UPDATE=97,cinder:DELETE=8 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:17:12 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=86,cinder:UPDATE=97,cinder:INSERT=29,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:17:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:12 devstack sudo[110941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 Jun 26 22:17:12 devstack sudo[110941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:13 devstack sudo[110941]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257" returned: 0 in 0.660s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:17:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96ed5921-ac02-45b8-b898-fa06dc332812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39574819-d0ed-4524-bccb-9e19bd9a6730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Volume volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 (585e66a6-ebc2-4cc7-a3e5-8fe942127257): created successfully Jun 26 22:17:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39574819-d0ed-4524-bccb-9e19bd9a6730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Flow 'volume_create_manager' (3c5b09d8-659d-4bec-ab98-3ed4674e73de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1f8726ef-5fde-479e-9eb5-852cd534fecd tempest-VolumesListTestJSON-1534146630 None] Created volume successfully. Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Flow 'volume_create_manager' (6d058946-7a0e-4935-966d-79ff2e715217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a56783-4d72-4d5f-a370-a63c3e050405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a56783-4d72-4d5f-a370-a63c3e050405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-304447582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25df21cd-cb83-4ca9-9760-432c22cbce5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35aa119edfc8482787a83ddd545b3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:14Z,use_quota=True,user_id='8598f840ccaf4d4785365c24a571db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc11f727-9ca4-4406-aa4d-cc97a8618914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc11f727-9ca4-4406-aa4d-cc97a8618914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fc6ec4-f634-49b8-92f8-98300581d02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fc6ec4-f634-49b8-92f8-98300581d02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25df21cd-cb83-4ca9-9760-432c22cbce5a', 'volume_name': 'volume-25df21cd-cb83-4ca9-9760-432c22cbce5a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76246534-151a-40f0-9345-5b045dac6308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76246534-151a-40f0-9345-5b045dac6308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4317fc-a12e-4e7f-86ee-90acdc030fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:14 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Volume 25df21cd-cb83-4ca9-9760-432c22cbce5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25df21cd-cb83-4ca9-9760-432c22cbce5a', 'volume_size': 1} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-304447582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25df21cd-cb83-4ca9-9760-432c22cbce5a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='35aa119edfc8482787a83ddd545b3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:14Z,use_quota=True,user_id='8598f840ccaf4d4785365c24a571db8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Creating volume 25df21cd-cb83-4ca9-9760-432c22cbce5a {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:17:14 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:17:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:14 devstack sudo[110944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a 1073741824 Jun 26 22:17:14 devstack sudo[110944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:15 devstack sudo[110944]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a 1073741824" returned: 0 in 0.882s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:15 devstack sudo[110952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a Jun 26 22:17:15 devstack sudo[110952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:15 devstack sudo[110952]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a" returned: 0 in 0.649s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4317fc-a12e-4e7f-86ee-90acdc030fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25df21cd-cb83-4ca9-9760-432c22cbce5a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf076a2-4928-4d9f-8d93-ac5348636040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Volume volume-25df21cd-cb83-4ca9-9760-432c22cbce5a (25df21cd-cb83-4ca9-9760-432c22cbce5a): created successfully Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adf076a2-4928-4d9f-8d93-ac5348636040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Flow 'volume_create_manager' (6d058946-7a0e-4935-966d-79ff2e715217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9d761064-90ad-4878-9b67-1b31ac0d593f tempest-VolumesListTestJSON-1534146630 None] Created volume successfully. Jun 26 22:17:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "cinder-25df21cd-cb83-4ca9-9760-432c22cbce5a-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-25df21cd-cb83-4ca9-9760-432c22cbce5a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "cinder-quobyte-25df21cd-cb83-4ca9-9760-432c22cbce5a" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-quobyte-25df21cd-cb83-4ca9-9760-432c22cbce5a" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:18 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d4faa7-0c4d-40e6-84f5-7680bc6a9748]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:18 devstack sudo[110956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a Jun 26 22:17:18 devstack sudo[110956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:19 devstack sudo[110956]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a" returned: 0 in 0.796s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:19 devstack sudo[110961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a Jun 26 22:17:19 devstack sudo[110961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:20 devstack sudo[110961]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-25df21cd-cb83-4ca9-9760-432c22cbce5a" returned: 0 in 0.689s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-quobyte-25df21cd-cb83-4ca9-9760-432c22cbce5a" released by "delete_volume" :: held 1.540s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Created reservations ['c8f1f08e-6f69-48b5-8688-c0e5758df605', 'f829d969-7293-4f4d-b9f6-04a59c265a4d', 'd0c9954b-bdc4-409f-b1c4-4df8acbfad72', '3d3738c6-ffe2-4af9-a792-9192c08d59b6'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:20 devstack sudo[110964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:17:20 devstack sudo[110964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:20 devstack sudo[110964]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.676s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:17:20 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Deleted volume successfully. Jun 26 22:17:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-633ec795-4c42-42e6-8e40-202db1311fe6 tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-25df21cd-cb83-4ca9-9760-432c22cbce5a-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "cinder-585e66a6-ebc2-4cc7-a3e5-8fe942127257-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-585e66a6-ebc2-4cc7-a3e5-8fe942127257-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "cinder-quobyte-585e66a6-ebc2-4cc7-a3e5-8fe942127257" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-quobyte-585e66a6-ebc2-4cc7-a3e5-8fe942127257" acquired by "delete_volume" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f04a78-b610-41a4-9c3d-1f86238aa8fc]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:21 devstack sudo[110967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 Jun 26 22:17:21 devstack sudo[110967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:22 devstack sudo[110967]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257" returned: 0 in 0.927s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:22 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257 Jun 26 22:17:22 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:22 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-585e66a6-ebc2-4cc7-a3e5-8fe942127257" returned: 0 in 0.699s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-quobyte-585e66a6-ebc2-4cc7-a3e5-8fe942127257" released by "delete_volume" :: held 1.675s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Created reservations ['25fbc828-0766-4c35-a54a-1753bb9731be', 'c7ee7f62-b0ba-46fa-84d2-a5b20c4e7d25', '0dd47235-e452-44ec-8925-6e4a82ed52a6', '005bc9a6-c4c0-4873-8100-063b92d4b058'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:22 devstack sudo[110979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:17:22 devstack sudo[110979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "cinder-4f08dd09-a353-49b8-89b0-8865ceaa0384-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-4f08dd09-a353-49b8-89b0-8865ceaa0384-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "cinder-quobyte-4f08dd09-a353-49b8-89b0-8865ceaa0384" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-quobyte-4f08dd09-a353-49b8-89b0-8865ceaa0384" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b2eb52-5d61-4d8b-a34c-18a6ffe6103c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:23 devstack sudo[110979]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.711s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:17:23 devstack sudo[110982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 Jun 26 22:17:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Deleted volume successfully. Jun 26 22:17:23 devstack sudo[110982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b72fbf8d-cb42-46c5-97c4-2ddf4995feeb tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-585e66a6-ebc2-4cc7-a3e5-8fe942127257-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:24 devstack sudo[110982]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384" returned: 0 in 0.888s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:24 devstack sudo[110987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384 Jun 26 22:17:24 devstack sudo[110987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:25 devstack sudo[110987]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4f08dd09-a353-49b8-89b0-8865ceaa0384" returned: 0 in 0.671s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-quobyte-4f08dd09-a353-49b8-89b0-8865ceaa0384" released by "delete_volume" :: held 1.601s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Created reservations ['d12953bd-544d-4ede-bbcb-e50d3eda26c5', 'b4878292-321b-4de3-ab81-fb7c2d0fc7ce', '4958c1c8-a972-4170-ae9c-f3095db2d82d', '4c52a74f-127d-47fb-a762-6e22f3b23926'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:25 devstack sudo[110993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:17:25 devstack sudo[110993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:25 devstack sudo[110993]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.728s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:17:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Deleted volume successfully. Jun 26 22:17:25 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c9e358c9-23cd-42ed-b30e-c2f92ef9e76b tempest-VolumesListTestJSON-1534146630 None] Lock "cinder-4f08dd09-a353-49b8-89b0-8865ceaa0384-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:35 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=37,cinder:SELECT=16,cinder:INSERT=6 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:17:35 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=19,cinder:INSERT=8,cinder:UPDATE=21,cinder:DELETE=5 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (a9ce511c-8ca0-4a44-a849-7fd79789886b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8d6085-02f0-4da4-b7dc-39227037dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8d6085-02f0-4da4-b7dc-39227037dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1945983721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f30b50f-2135-4750-9bbd-2ea3cceac99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:38Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9764eecc-eb12-4ce6-900d-1fbdfb9188c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9764eecc-eb12-4ce6-900d-1fbdfb9188c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6bc57a-15ea-4bb9-bf2c-86cbeb687545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b6bc57a-15ea-4bb9-bf2c-86cbeb687545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f30b50f-2135-4750-9bbd-2ea3cceac99e', 'volume_name': 'volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d62f37-888f-4296-a2dd-3f569075f237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d62f37-888f-4296-a2dd-3f569075f237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f777aecd-2ad7-46cd-b466-95894bf08a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume 2f30b50f-2135-4750-9bbd-2ea3cceac99e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e', 'volume_size': 1} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1945983721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f30b50f-2135-4750-9bbd-2ea3cceac99e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:38Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Creating volume 2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:17:38 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:17:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:38 devstack sudo[110998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e 1073741824 Jun 26 22:17:38 devstack sudo[110998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:39 devstack sudo[110998]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e 1073741824" returned: 0 in 0.945s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:39 devstack sudo[111004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e Jun 26 22:17:39 devstack sudo[111004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:39 devstack sudo[111004]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e" returned: 0 in 0.628s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f777aecd-2ad7-46cd-b466-95894bf08a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c385c173-4223-4c68-b1f6-9b940eb96237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e (2f30b50f-2135-4750-9bbd-2ea3cceac99e): created successfully Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c385c173-4223-4c68-b1f6-9b940eb96237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (a9ce511c-8ca0-4a44-a849-7fd79789886b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0b0df52b-c9eb-4884-8b30-866a1741b437 tempest-VolumesSnapshotTestJSON-1942355336 None] Created volume successfully. Jun 26 22:17:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Creating offline snapshot e170556d-dbc1-4917-9256-e020019dc2d3 of volume 2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:17:40 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cfc3a3-8d72-4df6-ba52-2a2503b2329a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:40 devstack sudo[111007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e Jun 26 22:17:40 devstack sudo[111007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:41 devstack sudo[111007]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e" returned: 0 in 0.916s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:41 devstack sudo[111012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 1G Jun 26 22:17:41 devstack sudo[111012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:42 devstack sudo[111012]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 1G" returned: 0 in 0.864s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:42 devstack sudo[111018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 Jun 26 22:17:42 devstack sudo[111018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:43 devstack sudo[111018]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3" returned: 0 in 0.799s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:43 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 is being set with open permissions: ugo+rw Jun 26 22:17:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:43 devstack sudo[111024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 Jun 26 22:17:43 devstack sudo[111024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:43 devstack sudo[111024]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3" returned: 0 in 0.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:43 devstack sudo[111033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.info Jun 26 22:17:43 devstack sudo[111033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:44 devstack sudo[111033]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.info" returned: 0 in 0.682s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:44 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.info is being set with open permissions: ugo+rw Jun 26 22:17:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:44 devstack sudo[111036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.info Jun 26 22:17:44 devstack sudo[111036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:44 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:17:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Flow 'volume_create_manager' (70e9da3e-c2ea-44d5-a38f-1515f6c315a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef445cb3-353d-4d10-9c8d-8fdc49ab4f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef445cb3-353d-4d10-9c8d-8fdc49ab4f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1874273477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e80e8a2c21458595f4a06379745bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:45Z,use_quota=True,user_id='e67ad0f25cb14c4fb3faab81cfab3cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdde9f0-df55-4f1b-9c9b-be9f3835709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfdde9f0-df55-4f1b-9c9b-be9f3835709e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e657b3-d829-457a-bcb1-97b199433c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e657b3-d829-457a-bcb1-97b199433c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d', 'volume_name': 'volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:45 devstack sudo[111036]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a337c9-3df0-4923-9209-f75497d44b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a337c9-3df0-4923-9209-f75497d44b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e05266-9fac-493b-9203-246e05e5fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:45 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Volume 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Trying to clone 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d from image 57efc2e5-cc7c-4583-b444-d036b0944149 at location (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.info" returned: 0 in 0.673s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.735s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:45 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6934aeb3-9946-4efa-afaa-e9cee75d357e tempest-VolumesSnapshotTestJSON-1942355336 None] Create snapshot completed successfully Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:17:45 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Image download 20.69 MB at 20.69 MB/s Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c226c3-4fdb-4fa4-ad62-726f81e57229]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:45 devstack sudo[111041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD Jun 26 22:17:45 devstack sudo[111041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-e170556d-dbc1-4917-9256-e020019dc2d3-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-e170556d-dbc1-4917-9256-e020019dc2d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-2f30b50f-2135-4750-9bbd-2ea3cceac99e" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-2f30b50f-2135-4750-9bbd-2ea3cceac99e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-e170556d-dbc1-4917-9256-e020019dc2d3" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-e170556d-dbc1-4917-9256-e020019dc2d3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Deleting offline snapshot e170556d-dbc1-4917-9256-e020019dc2d3 of volume 2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] snapshot_file for this snap is: volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c040f4d-b56c-45f1-8750-04d9ae07c797]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:46 devstack sudo[111043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 Jun 26 22:17:46 devstack sudo[111043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:46 devstack sudo[111048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:17:46 devstack sudo[111048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:46 devstack sudo[111041]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD" returned: 0 in 0.773s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 is fetched for user e67ad0f25cb14c4fb3faab81cfab3cb4. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e334f4-2b00-4c52-9927-11153ce2dfb8]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:46 devstack sudo[111050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD Jun 26 22:17:46 devstack sudo[111050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:46 devstack sudo[111043]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3" returned: 0 in 0.800s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[38cec675-f478-4634-b25a-50eaa745ec1c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:46 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e Jun 26 22:17:46 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:47 devstack sudo[111048]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.732s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:17:47 devstack sudo[111050]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1874273477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1e80e8a2c21458595f4a06379745bd0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:45Z,use_quota=True,user_id='e67ad0f25cb14c4fb3faab81cfab3cb4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Creating volume 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:17:47 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:47 devstack sudo[111061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d 1073741824 Jun 26 22:17:47 devstack sudo[111061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:47 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e" returned: 0 in 0.779s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:47 devstack sudo[111066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 Jun 26 22:17:47 devstack sudo[111066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:48 devstack sudo[111061]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d 1073741824" returned: 0 in 0.865s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:48 devstack sudo[111071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:17:48 devstack sudo[111071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:48 devstack sudo[111066]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3" returned: 0 in 0.742s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:48 devstack sudo[111076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3 Jun 26 22:17:48 devstack sudo[111076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:48 devstack sudo[111071]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 0 in 0.645s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Attempting download of 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a196465-c22e-4988-91ab-7b9029cfcb89]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_07nn_2xt {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:49 devstack sudo[111079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_07nn_2xt Jun 26 22:17:49 devstack sudo[111079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:49 devstack sudo[111076]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e.e170556d-dbc1-4917-9256-e020019dc2d3" returned: 0 in 0.704s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-e170556d-dbc1-4917-9256-e020019dc2d3" released by "_delete_snapshot" :: held 3.127s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-2f30b50f-2135-4750-9bbd-2ea3cceac99e" released by "delete_snapshot" :: held 3.159s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:49 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['993d8cdb-ed59-443b-8a6c-a2f9adc2f162', '61ec24fd-6e18-435e-a4f3-67f1879f031c', '133d9f31-b8ee-4f9a-b7c9-e611e4d21b7f', 'bf5778b1-f1e8-4348-82d3-3c0ac9a7f40e'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:17:49 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Delete snapshot completed successfully. Jun 26 22:17:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec093482-31f6-4c91-9215-47c8daf694a4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-e170556d-dbc1-4917-9256-e020019dc2d3-delete_snapshot" released by "delete_snapshot" :: held 3.321s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:17:49 devstack sudo[111079]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_07nn_2xt" returned: 0 in 0.715s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_07nn_2xt {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:49 devstack sudo[111084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_07nn_2xt Jun 26 22:17:49 devstack sudo[111084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:50 devstack sudo[111084]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_07nn_2xt" returned: 1 in 0.735s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_57efc2e5-cc7c-4583-b444-d036b0944149_07nn_2xt' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7224dcb0-5463-4427-8f0b-1cc7ddb94593]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:50 devstack sudo[111088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD Jun 26 22:17:50 devstack sudo[111088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (4a9f2357-ae3b-46c9-82a6-4d8acc2f5f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a34f0de-cced-47c3-b11d-0af67007caf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a34f0de-cced-47c3-b11d-0af67007caf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2052878823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:51Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb6a70f-7883-46ea-8536-d27a18f70de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb6a70f-7883-46ea-8536-d27a18f70de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb3e1ec-5842-46c2-9aa7-2af04f12bffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb3e1ec-5842-46c2-9aa7-2af04f12bffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3', 'volume_name': 'volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db45aaa9-809a-464b-b16f-aaf6488d167c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db45aaa9-809a-464b-b16f-aaf6488d167c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154b53eb-0528-4b1e-a949-6bb463363f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:50 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3', 'volume_size': 1} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2052878823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:51Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Creating volume ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:17:50 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:17:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:50 devstack sudo[111090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 1073741824 Jun 26 22:17:50 devstack sudo[111090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:51 devstack sudo[111088]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:51 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] 57efc2e5-cc7c-4583-b444-d036b0944149 was qcow2, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:17:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:51 devstack sudo[111095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:17:51 devstack sudo[111095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:51 devstack sudo[111090]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 1073741824" returned: 0 in 0.857s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:51 devstack sudo[111103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 Jun 26 22:17:51 devstack sudo[111103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:52 devstack sudo[111103]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" returned: 0 in 0.709s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (154b53eb-0528-4b1e-a949-6bb463363f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b9f1c4-8f04-4a1f-a8e5-babea5c3aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:52 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 (ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3): created successfully Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b9f1c4-8f04-4a1f-a8e5-babea5c3aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (4a9f2357-ae3b-46c9-82a6-4d8acc2f5f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d0a3cf19-d738-4c3a-8066-4cd34742df49 tempest-VolumesSnapshotTestJSON-1942355336 None] Created volume successfully. Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Creating offline snapshot 361a9573-2f85-4fc4-93be-f8f7e655e75b of volume ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c404e211-3e99-4dde-a446-26dbbe9f6833]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:52 devstack sudo[111095]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 0 in 1.893s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_57efc2e5-cc7c-4583-b444-d036b0944149_4v7zfi9ydevstack@QuobyteHD, size 112.00 MB, duration 1.90 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:17:52 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Converted 112.00 MB image at 59.10 MB/s Jun 26 22:17:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:53 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d 1G Jun 26 22:17:53 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:53 devstack sudo[111109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 Jun 26 22:17:53 devstack sudo[111109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:53 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d 1G" returned: 0 in 0.716s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:53 devstack sudo[111109]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" returned: 0 in 0.763s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:53 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bd037d-ef5f-4c7b-ac31-e1423a1e5cda]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:53 devstack sudo[111119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b 1G Jun 26 22:17:53 devstack sudo[111119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:53 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:17:53 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:54 devstack sudo[111119]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b 1G" returned: 0 in 0.814s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:54 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 0 in 0.816s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:54 devstack sudo[111129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b Jun 26 22:17:54 devstack sudo[111129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:54 devstack sudo[111130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:17:54 devstack sudo[111130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:55 devstack sudo[111129]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b" returned: 0 in 0.691s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:55 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b is being set with open permissions: ugo+rw Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:55 devstack sudo[111139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b Jun 26 22:17:55 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:55 devstack sudo[111130]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 1 in 0.818s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Downloaded image 57efc2e5-cc7c-4583-b444-d036b0944149 ((None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}])) to volume 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Temporary image 57efc2e5-cc7c-4583-b444-d036b0944149 for user e67ad0f25cb14c4fb3faab81cfab3cb4 is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Marking volume 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Copying metadata from image 57efc2e5-cc7c-4583-b444-d036b0944149 to 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Creating volume glance metadata for volume 8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d backed by image 57efc2e5-cc7c-4583-b444-d036b0944149 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27e05266-9fac-493b-9203-246e05e5fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d', 'volume_size': 1, 'image_id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/57efc2e5-cc7c-4583-b444-d036b0944149', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6538459eca0d44389bc6d83153553d0e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '57efc2e5-cc7c-4583-b444-d036b0944149', 'created_at': datetime.datetime(2026, 6, 26, 19, 53, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 19, 53, 58, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/57efc2e5-cc7c-4583-b444-d036b0944149/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8d54d5-c86d-4919-b980-99c72b61c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:55 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Volume volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d (8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d): created successfully Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b8d54d5-c86d-4919-b980-99c72b61c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Flow 'volume_create_manager' (70e9da3e-c2ea-44d5-a38f-1515f6c315a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:55 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-00cc705d-f28b-4675-8fac-42871b5ec1f7 tempest-TestShelveInstance-119197940 None] Created volume successfully. Jun 26 22:17:55 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b" returned: 0 in 0.633s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:55 devstack sudo[111143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.info Jun 26 22:17:55 devstack sudo[111143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:56 devstack sudo[111143]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.info" returned: 0 in 0.670s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:56 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.info is being set with open permissions: ugo+rw Jun 26 22:17:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:56 devstack sudo[111146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.info Jun 26 22:17:56 devstack sudo[111146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:57 devstack sudo[111146]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.info" returned: 0 in 0.695s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.356s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e3cde714-b302-484e-99c3-528179dbd2b3 tempest-VolumesSnapshotTestJSON-1942355336 None] Create snapshot completed successfully Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (03c70bd6-f05f-4609-9578-9833de4ba01b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26514f62-5a44-4d17-888b-00634bfaef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26514f62-5a44-4d17-888b-00634bfaef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:17:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1507548754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50124f41-9f41-4152-9b1e-515e6abd3ed9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:17:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=361a9573-2f85-4fc4-93be-f8f7e655e75b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:17:59Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071bbcba-c5b4-46a5-8247-e83f09a5ee26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (071bbcba-c5b4-46a5-8247-e83f09a5ee26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f05675-d0ac-4e1e-a028-ad35656bce84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f05675-d0ac-4e1e-a028-ad35656bce84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '50124f41-9f41-4152-9b1e-515e6abd3ed9', 'volume_name': 'volume-50124f41-9f41-4152-9b1e-515e6abd3ed9', 'volume_size': 2, 'snapshot_id': '361a9573-2f85-4fc4-93be-f8f7e655e75b'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b8f776-657b-4328-a83b-c19c772975d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b8f776-657b-4328-a83b-c19c772975d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0930d3f-fb15-4d1d-a488-247397449995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:17:58 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Volume 50124f41-9f41-4152-9b1e-515e6abd3ed9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-50124f41-9f41-4152-9b1e-515e6abd3ed9', 'volume_size': 2, 'snapshot_id': '361a9573-2f85-4fc4-93be-f8f7e655e75b'} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-361a9573-2f85-4fc4-93be-f8f7e655e75b-50124f41-9f41-4152-9b1e-515e6abd3ed9" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-361a9573-2f85-4fc4-93be-f8f7e655e75b-50124f41-9f41-4152-9b1e-515e6abd3ed9" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Creating volume 50124f41-9f41-4152-9b1e-515e6abd3ed9 from snapshot 361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-50124f41-9f41-4152-9b1e-515e6abd3ed9" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-50124f41-9f41-4152-9b1e-515e6abd3ed9" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] snapshot: 361a9573-2f85-4fc4-93be-f8f7e655e75b, volume: 50124f41-9f41-4152-9b1e-515e6abd3ed9, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b688ea4d-07dc-447f-ac21-1ad51dc3812f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:59 devstack sudo[111152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b Jun 26 22:17:59 devstack sudo[111152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:17:59 devstack sudo[111152]: pam_unix(sudo:session): session closed for user root Jun 26 22:17:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b" returned: 0 in 0.763s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:17:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:17:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:17:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:17:59 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a05bf2-0cab-4a10-b476-84c928279322]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:17:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:17:59 devstack sudo[111157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 Jun 26 22:17:59 devstack sudo[111157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:00 devstack sudo[111157]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" returned: 0 in 0.757s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:00 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:18:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:00 devstack sudo[111162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 Jun 26 22:18:00 devstack sudo[111162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:06 devstack sudo[111162]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9" returned: 0 in 5.631s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:06 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f14d9c-0ea0-48ef-8eef-7cdf1b7b71d1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:06 devstack sudo[111184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 Jun 26 22:18:06 devstack sudo[111184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:07 devstack sudo[111184]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" returned: 0 in 0.949s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:18:07 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Converted 1024.00 MB image at 181.83 MB/s Jun 26 22:18:07 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 is being set with open permissions: ugo+rw Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:07 devstack sudo[111190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 Jun 26 22:18:07 devstack sudo[111190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:07 devstack sudo[111190]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9" returned: 0 in 0.659s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-50124f41-9f41-4152-9b1e-515e6abd3ed9" released by "_copy_volume_from_snapshot" :: held 8.859s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-361a9573-2f85-4fc4-93be-f8f7e655e75b-50124f41-9f41-4152-9b1e-515e6abd3ed9" released by "_create_volume_from_snapshot" :: held 8.886s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.901s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.181s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0930d3f-fb15-4d1d-a488-247397449995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50124f41-9f41-4152-9b1e-515e6abd3ed9', 'volume_size': 2, 'snapshot_id': '361a9573-2f85-4fc4-93be-f8f7e655e75b'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e292216-6c55-495f-ac1f-466dc03d2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ed91e6-8a8f-47a8-a685-d92630d5b9b0]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:07 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Volume volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 (50124f41-9f41-4152-9b1e-515e6abd3ed9): created successfully Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e292216-6c55-495f-ac1f-466dc03d2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:07 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (03c70bd6-f05f-4609-9578-9833de4ba01b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:18:07 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-dcb785f2-d358-4eaf-a232-38b9dd44ea2e tempest-VolumesSnapshotTestJSON-1942355336 None] Created volume successfully. Jun 26 22:18:07 devstack sudo[111193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:18:07 devstack sudo[111193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:08 devstack sudo[111193]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 0 in 0.821s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-50124f41-9f41-4152-9b1e-515e6abd3ed9-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-50124f41-9f41-4152-9b1e-515e6abd3ed9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-50124f41-9f41-4152-9b1e-515e6abd3ed9" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:08 devstack sudo[111233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-50124f41-9f41-4152-9b1e-515e6abd3ed9" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:08 devstack sudo[111233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[317b45e0-8754-4b73-9a50-f38b624f0721]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:08 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 Jun 26 22:18:08 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:09 devstack sudo[111233]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 1 in 0.796s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:18:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.665s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0f497e63-de8e-4c41-9ce2-72233977d085', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:18:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-292338b6-3f9b-440e-9c5e-d03e449330a7 req-338e2f73-a671-4efb-8cc9-b87e8c2e5188 tempest-TestShelveInstance-119197940 None] attachment_update completed successfully. Jun 26 22:18:09 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9" returned: 0 in 0.841s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:09 devstack sudo[111243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9 Jun 26 22:18:09 devstack sudo[111243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:10 devstack sudo[111243]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-50124f41-9f41-4152-9b1e-515e6abd3ed9" returned: 0 in 0.665s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-50124f41-9f41-4152-9b1e-515e6abd3ed9" released by "delete_volume" :: held 1.551s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['ec4f4284-de76-4e07-9cda-34763548c8a8', '2f3003e4-3ba9-4040-bfcf-8cd597d816e3', 'e647c438-5806-4807-b652-a35499456c3b', '6debf827-98cf-43a1-a0ef-14d7bfd842ac'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:10 devstack sudo[111246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:18:10 devstack sudo[111246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-361a9573-2f85-4fc4-93be-f8f7e655e75b-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-361a9573-2f85-4fc4-93be-f8f7e655e75b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-361a9573-2f85-4fc4-93be-f8f7e655e75b" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-361a9573-2f85-4fc4-93be-f8f7e655e75b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Deleting offline snapshot 361a9573-2f85-4fc4-93be-f8f7e655e75b of volume ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] snapshot_file for this snap is: volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7823475b-fd07-4d2d-ba27-f4e6a2e82292]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:11 devstack sudo[111246]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.706s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:18:11 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Deleted volume successfully. Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-fc0be182-de8c-4e3a-8535-3d807e387865 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-50124f41-9f41-4152-9b1e-515e6abd3ed9-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:11 devstack sudo[111249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b Jun 26 22:18:11 devstack sudo[111249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:11 devstack sudo[111249]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b" returned: 0 in 0.791s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c939e04-18a1-4d49-8d59-494784fd64be]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:11 devstack sudo[111321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 Jun 26 22:18:11 devstack sudo[111321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:12 devstack sudo[111321]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" returned: 0 in 0.790s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:12 devstack sudo[111326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b Jun 26 22:18:12 devstack sudo[111326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:13 devstack sudo[111326]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b" returned: 0 in 0.787s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:13 devstack sudo[111334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b Jun 26 22:18:13 devstack sudo[111334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:14 devstack sudo[111334]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3.361a9573-2f85-4fc4-93be-f8f7e655e75b" returned: 0 in 0.629s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-361a9573-2f85-4fc4-93be-f8f7e655e75b" released by "_delete_snapshot" :: held 3.108s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" released by "delete_snapshot" :: held 3.133s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:14 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['26b12025-dea3-4aea-bb36-501525ac84c5', 'c1ecc7dd-bb69-473a-9d1a-dafcd76d90b0', '5d7e7cfb-cc5c-42ed-8b99-48f6e2e3a5c6', 'cbd2b9d1-b8e1-4db7-bfa3-e2ff1c39a424'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:18:14 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Delete snapshot completed successfully. Jun 26 22:18:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-11cf853e-42c6-44ee-b1ac-eca2689b4036 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-361a9573-2f85-4fc4-93be-f8f7e655e75b-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:15 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03b6304-0d39-43f1-976c-76cc9fe86618]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:15 devstack sudo[111699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 Jun 26 22:18:15 devstack sudo[111699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:16 devstack sudo[111699]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" returned: 0 in 0.994s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:16 devstack sudo[111733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3 Jun 26 22:18:16 devstack sudo[111733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:17 devstack sudo[111733]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" returned: 0 in 0.675s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3" released by "delete_volume" :: held 1.782s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['f43267b9-7d16-4f98-918b-79187d67ae28', '56703624-f06e-4e5f-b8fc-30de1f701542', 'ccff0926-d279-47f9-a02d-24535e84551b', '5cf168da-1fbf-48c0-acc4-743a306f24e1'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:17 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:18:17 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:18 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.918s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:18:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Deleted volume successfully. Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (4ffdf9d3-4795-4972-b12f-a5fbed3d35b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3895a22d-5c8d-4ef6-a539-37ced9318750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3895a22d-5c8d-4ef6-a539-37ced9318750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-398658277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dcd9ca-cda1-4188-b30e-444374d68621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:18:18Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fb81c8-f273-457b-82d3-528a44361b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92fb81c8-f273-457b-82d3-528a44361b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23cc419-fff3-4881-abea-5eebcf0ec47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23cc419-fff3-4881-abea-5eebcf0ec47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39dcd9ca-cda1-4188-b30e-444374d68621', 'volume_name': 'volume-39dcd9ca-cda1-4188-b30e-444374d68621', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8245128a-641b-41b8-993e-794a7a30fdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8245128a-641b-41b8-993e-794a7a30fdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253bbe2d-1f0a-446d-a936-95498d5b8d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:18 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume 39dcd9ca-cda1-4188-b30e-444374d68621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39dcd9ca-cda1-4188-b30e-444374d68621', 'volume_size': 1} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-398658277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39dcd9ca-cda1-4188-b30e-444374d68621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:18:18Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Creating volume 39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:18:18 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f528280e-7f24-48e2-9998-649b140962a3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-ba769cbc-afdd-4a7a-adcc-3e4ed231f0d3-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:18 devstack sudo[111741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 1073741824 Jun 26 22:18:18 devstack sudo[111741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:19 devstack sudo[111741]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 1073741824" returned: 0 in 1.005s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:19 devstack sudo[111747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 Jun 26 22:18:19 devstack sudo[111747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:20 devstack sudo[111747]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621" returned: 0 in 0.709s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.769s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (253bbe2d-1f0a-446d-a936-95498d5b8d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39dcd9ca-cda1-4188-b30e-444374d68621', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d56edf-1aa6-4a2c-9d1a-983b88cf68b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:20 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume volume-39dcd9ca-cda1-4188-b30e-444374d68621 (39dcd9ca-cda1-4188-b30e-444374d68621): created successfully Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d56edf-1aa6-4a2c-9d1a-983b88cf68b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (4ffdf9d3-4795-4972-b12f-a5fbed3d35b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:18:20 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-50777935-26cd-4249-8733-d06fef7783c0 tempest-VolumesSnapshotTestJSON-1942355336 None] Created volume successfully. Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Creating offline snapshot 9063f60e-5bba-414f-bd72-be9d82081391 of volume 39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[511ed31a-3423-4294-a88e-fc60c0b34b26]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:20 devstack sudo[111750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 Jun 26 22:18:20 devstack sudo[111750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:21 devstack sudo[111750]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621" returned: 0 in 0.893s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:21 devstack sudo[111756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 1G Jun 26 22:18:21 devstack sudo[111756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:22 devstack sudo[111756]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 1G" returned: 0 in 0.844s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39dcd9ca-cda1-4188-b30e-444374d68621 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:22 devstack sudo[111763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39dcd9ca-cda1-4188-b30e-444374d68621 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 Jun 26 22:18:22 devstack sudo[111763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:22 devstack sudo[111763]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-39dcd9ca-cda1-4188-b30e-444374d68621 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391" returned: 0 in 0.657s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:22 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 is being set with open permissions: ugo+rw Jun 26 22:18:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:23 devstack sudo[111768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 Jun 26 22:18:23 devstack sudo[111768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:23 devstack sudo[111768]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391" returned: 0 in 0.631s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:23 devstack sudo[111772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.info Jun 26 22:18:23 devstack sudo[111772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:24 devstack sudo[111772]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.info" returned: 0 in 0.671s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:24 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.info is being set with open permissions: ugo+rw Jun 26 22:18:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:24 devstack sudo[111775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.info Jun 26 22:18:24 devstack sudo[111775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:24 devstack sudo[111775]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.info" returned: 0 in 0.651s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.449s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9c1e14aa-2c45-474d-9b5d-00fd12132fe4 tempest-VolumesSnapshotTestJSON-1942355336 None] Create snapshot completed successfully Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (5b8e793f-b33d-49f2-8099-a295a12d9349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515466b7-6168-498d-ad78-a056cb68a27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515466b7-6168-498d-ad78-a056cb68a27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-967487012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc55b695-20eb-4811-8161-48601d883240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6001a193a3fb4004ac311c668f8be75a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9063f60e-5bba-414f-bd72-be9d82081391,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:18:26Z,use_quota=True,user_id='6d4d0c7ad9fa4409a10f540e7ccfc516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7327e6-02da-405f-99df-bdecc776aaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7327e6-02da-405f-99df-bdecc776aaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2076633-b19c-4bab-9b1d-4b060fd996d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2076633-b19c-4bab-9b1d-4b060fd996d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dc55b695-20eb-4811-8161-48601d883240', 'volume_name': 'volume-dc55b695-20eb-4811-8161-48601d883240', 'volume_size': 1, 'snapshot_id': '9063f60e-5bba-414f-bd72-be9d82081391'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c341b05a-29ac-41ac-ad8f-1e1083a18d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c341b05a-29ac-41ac-ad8f-1e1083a18d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26869a6-bcc6-430a-9203-a76df8cb3be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:26 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume dc55b695-20eb-4811-8161-48601d883240: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dc55b695-20eb-4811-8161-48601d883240', 'volume_size': 1, 'snapshot_id': '9063f60e-5bba-414f-bd72-be9d82081391'} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-9063f60e-5bba-414f-bd72-be9d82081391-dc55b695-20eb-4811-8161-48601d883240" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-9063f60e-5bba-414f-bd72-be9d82081391-dc55b695-20eb-4811-8161-48601d883240" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Creating volume dc55b695-20eb-4811-8161-48601d883240 from snapshot 9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-dc55b695-20eb-4811-8161-48601d883240" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-dc55b695-20eb-4811-8161-48601d883240" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] snapshot: 9063f60e-5bba-414f-bd72-be9d82081391, volume: dc55b695-20eb-4811-8161-48601d883240, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9c9311-f3c8-47b2-a4a3-c52012db929c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:26 devstack sudo[111782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 Jun 26 22:18:26 devstack sudo[111782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:27 devstack sudo[111782]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391" returned: 0 in 0.780s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39dcd9ca-cda1-4188-b30e-444374d68621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:18:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:18:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:18:27 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[343f0198-9b4c-4682-972b-76e81b414119]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:27 devstack sudo[111788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 Jun 26 22:18:27 devstack sudo[111788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:28 devstack sudo[111788]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621" returned: 0 in 0.742s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:28 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:18:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:28 devstack sudo[111793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 Jun 26 22:18:28 devstack sudo[111793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:32 devstack sudo[111793]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240" returned: 0 in 4.804s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:32 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[24dc2c6e-e277-42ab-8844-ff6000cd0f7d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:33 devstack sudo[111850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 Jun 26 22:18:33 devstack sudo[111850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:33 devstack sudo[111850]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621" returned: 0 in 0.974s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:33 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621, size 1024.00 MB, duration 4.80 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:18:33 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Converted 1024.00 MB image at 213.12 MB/s Jun 26 22:18:33 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 is being set with open permissions: ugo+rw Jun 26 22:18:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:33 devstack sudo[111882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 Jun 26 22:18:33 devstack sudo[111882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:34 devstack sudo[111882]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240" returned: 0 in 0.622s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-dc55b695-20eb-4811-8161-48601d883240" released by "_copy_volume_from_snapshot" :: held 8.009s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-9063f60e-5bba-414f-bd72-be9d82081391-dc55b695-20eb-4811-8161-48601d883240" released by "_create_volume_from_snapshot" :: held 8.038s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.059s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26869a6-bcc6-430a-9203-a76df8cb3be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc55b695-20eb-4811-8161-48601d883240', 'volume_size': 1, 'snapshot_id': '9063f60e-5bba-414f-bd72-be9d82081391'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d43f510-ded2-4704-bc72-d193f50d07b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:18:34 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Volume volume-dc55b695-20eb-4811-8161-48601d883240 (dc55b695-20eb-4811-8161-48601d883240): created successfully Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d43f510-ded2-4704-bc72-d193f50d07b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:18:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Flow 'volume_create_manager' (5b8e793f-b33d-49f2-8099-a295a12d9349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:18:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-05509eba-b9e6-4e7c-8e85-e369d4ab6cd1 tempest-VolumesSnapshotTestJSON-1942355336 None] Created volume successfully. Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-dc55b695-20eb-4811-8161-48601d883240-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-dc55b695-20eb-4811-8161-48601d883240-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-dc55b695-20eb-4811-8161-48601d883240" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-dc55b695-20eb-4811-8161-48601d883240" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89ca8fb-19e4-4a48-9e2c-7bbc34e61816]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:35 devstack sudo[111886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 Jun 26 22:18:35 devstack sudo[111886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:35 devstack sudo[111886]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240" returned: 0 in 0.734s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:36 devstack sudo[111891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240 Jun 26 22:18:36 devstack sudo[111891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:36 devstack sudo[111891]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-dc55b695-20eb-4811-8161-48601d883240" returned: 0 in 0.653s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-dc55b695-20eb-4811-8161-48601d883240" released by "delete_volume" :: held 1.423s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=48,cinder:SELECT=61,cinder:DELETE=3,cinder:INSERT=18 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=70,cinder:UPDATE=55,cinder:INSERT=18,cinder:DELETE=8 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['dae658a6-2968-4e6b-abf9-e96106243f2a', '2af8c61a-32ef-4e61-b7ba-f593a8103bb2', 'e3883c87-ee4d-42a7-a046-0a255e721551', '731339c8-22ca-4249-a20d-e05b164287ff'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:36 devstack sudo[111894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:18:36 devstack sudo[111894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:37 devstack sudo[111894]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.621s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:18:37 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Deleted volume successfully. Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-96c4a59c-bdc3-438e-a4bf-7a0c345bc550 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-dc55b695-20eb-4811-8161-48601d883240-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-9063f60e-5bba-414f-bd72-be9d82081391-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-9063f60e-5bba-414f-bd72-be9d82081391-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-39dcd9ca-cda1-4188-b30e-444374d68621" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-39dcd9ca-cda1-4188-b30e-444374d68621" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-9063f60e-5bba-414f-bd72-be9d82081391" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-9063f60e-5bba-414f-bd72-be9d82081391" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Deleting offline snapshot 9063f60e-5bba-414f-bd72-be9d82081391 of volume 39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] snapshot_file for this snap is: volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49b52c1-b445-43bb-950b-b3b1884e81d6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:37 devstack sudo[111897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 Jun 26 22:18:37 devstack sudo[111897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:38 devstack sudo[111897]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391" returned: 0 in 0.734s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-39dcd9ca-cda1-4188-b30e-444374d68621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:18:38 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6672e377-f2a5-43e6-871f-72b9140f8289]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:38 devstack sudo[111902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 Jun 26 22:18:38 devstack sudo[111902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:38 devstack sudo[111902]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621" returned: 0 in 0.724s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:39 devstack sudo[111907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 Jun 26 22:18:39 devstack sudo[111907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:39 devstack sudo[111907]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391" returned: 0 in 0.701s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:39 devstack sudo[111912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391 Jun 26 22:18:39 devstack sudo[111912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:40 devstack sudo[111912]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621.9063f60e-5bba-414f-bd72-be9d82081391" returned: 0 in 0.643s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-9063f60e-5bba-414f-bd72-be9d82081391" released by "_delete_snapshot" :: held 2.892s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-39dcd9ca-cda1-4188-b30e-444374d68621" released by "delete_snapshot" :: held 2.912s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['bab74021-da61-4d48-b7f3-cfb675bf91d4', '7f8420c4-8344-4333-895e-d440b4712d66', 'ea917159-8bd9-497f-a7ea-f956f22da381', 'cb69fff4-d857-4e88-b949-ad675126c896'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:18:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Delete snapshot completed successfully. Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-975b9b28-37ad-4eae-9af5-8d38d4a10edd tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-9063f60e-5bba-414f-bd72-be9d82081391-delete_snapshot" released by "delete_snapshot" :: held 3.050s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-39dcd9ca-cda1-4188-b30e-444374d68621-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-39dcd9ca-cda1-4188-b30e-444374d68621-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-39dcd9ca-cda1-4188-b30e-444374d68621" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-39dcd9ca-cda1-4188-b30e-444374d68621" acquired by "delete_volume" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[158c77ee-2942-4fc8-b662-32c6c30f7d72]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:40 devstack sudo[111915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 Jun 26 22:18:40 devstack sudo[111915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:41 devstack sudo[111915]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621" returned: 0 in 0.753s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:41 devstack sudo[111920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621 Jun 26 22:18:41 devstack sudo[111920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:42 devstack sudo[111920]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-39dcd9ca-cda1-4188-b30e-444374d68621" returned: 0 in 0.658s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-39dcd9ca-cda1-4188-b30e-444374d68621" released by "delete_volume" :: held 1.489s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['daf5d9b8-8194-4d2e-a3f2-7a48dc40ee9d', 'a225aac5-59ff-4689-8cdb-565be83f7c85', 'b77f9d23-5ca6-4caf-b25a-29429679f7c4', '5e3a8890-d20b-4308-b344-c29fa080cbe2'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:42 devstack sudo[111923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:18:42 devstack sudo[111923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-2f30b50f-2135-4750-9bbd-2ea3cceac99e-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-2f30b50f-2135-4750-9bbd-2ea3cceac99e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:43 devstack sudo[111923]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.647s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:18:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Deleted volume successfully. Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "cinder-quobyte-2f30b50f-2135-4750-9bbd-2ea3cceac99e" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-edd0af27-d7f5-40bc-bd29-40002dd5324c tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-39dcd9ca-cda1-4188-b30e-444374d68621-delete_volume" released by "delete_volume" :: held 2.367s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-2f30b50f-2135-4750-9bbd-2ea3cceac99e" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b308c5-0fbd-48c0-b3d6-90900ce4b175]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:43 devstack sudo[111926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e Jun 26 22:18:43 devstack sudo[111926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:43 devstack sudo[111926]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e" returned: 0 in 0.734s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:43 devstack sudo[111941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e Jun 26 22:18:43 devstack sudo[111941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:44 devstack sudo[111941]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2f30b50f-2135-4750-9bbd-2ea3cceac99e" returned: 0 in 0.646s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-quobyte-2f30b50f-2135-4750-9bbd-2ea3cceac99e" released by "delete_volume" :: held 1.432s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Created reservations ['2d8d100a-b65a-4dba-a7a9-6470daaf426e', '963a922a-f395-4adc-b4de-2197c963c7ab', 'b797f2bf-bcf1-4aeb-b483-7528f472bf1a', '897cf906-c6d6-4874-9227-ce1d10722e51'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:44 devstack sudo[111946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:18:44 devstack sudo[111946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:45 devstack sudo[111946]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.628s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:45 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:18:45 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Deleted volume successfully. Jun 26 22:18:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b08fbe6-73d4-4ce9-b2e5-1441475db0f3 tempest-VolumesSnapshotTestJSON-1942355336 None] Lock "cinder-2f30b50f-2135-4750-9bbd-2ea3cceac99e-delete_volume" released by "delete_volume" :: held 2.286s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:18:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:18:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:18:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:18:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:46 devstack sudo[111988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:18:46 devstack sudo[111988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:47 devstack sudo[111988]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.716s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:18:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:18:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:18:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:18:50 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-da9cbfd1-0ed1-4f86-ae07-42179af06637 req-35a95fd8-5553-4155-8b53-e7737e329673 tempest-TestShelveInstance-119197940 None] Terminate volume connection completed successfully. Jun 26 22:18:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-da9cbfd1-0ed1-4f86-ae07-42179af06637 req-35a95fd8-5553-4155-8b53-e7737e329673 tempest-TestShelveInstance-119197940 None] Deleting attachment 0f497e63-de8e-4c41-9ce2-72233977d085. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:18:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:18:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:18:55 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b957ac3a-d71b-410f-a21a-fc204adda5ba]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:18:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:55 devstack sudo[112010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:18:55 devstack sudo[112010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:56 devstack sudo[112010]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 0 in 0.923s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:18:56 devstack sudo[112014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:18:56 devstack sudo[112014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:18:57 devstack sudo[112014]: pam_unix(sudo:session): session closed for user root Jun 26 22:18:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 1 in 0.855s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:18:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:18:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.831s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:18:57 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cbd13e9-be89-4a47-8495-3faee5ecdfcc', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:18:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-1de1aa2d-c02d-49be-bc68-7443f049ccb4 req-ad8fe4a7-e4ae-4b0c-b11f-0039bded5791 tempest-TestShelveInstance-119197940 None] attachment_update completed successfully. Jun 26 22:19:07 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=25,cinder:SELECT=27,cinder:DELETE=2,cinder:INSERT=8 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:19:07 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=36,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Flow 'volume_create_manager' (8e81897f-0ade-4eea-94b7-7d9ce12a0b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45325f29-54b8-4757-9f4c-0e68924ddfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45325f29-54b8-4757-9f4c-0e68924ddfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1050058334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6661d57-5820-4355-87f5-c162b39769e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6539719f86b4471b02d90a98ef32975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:19:13Z,use_quota=True,user_id='650ac9b66e38434b8469af7c0c56cbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f002da31-ffe1-40b6-b6b8-7dcfe45c6c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f002da31-ffe1-40b6-b6b8-7dcfe45c6c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ecef9a-df41-4035-a7d4-eaa1c19bd72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ecef9a-df41-4035-a7d4-eaa1c19bd72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6661d57-5820-4355-87f5-c162b39769e5', 'volume_name': 'volume-d6661d57-5820-4355-87f5-c162b39769e5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fd15a5-a7b3-4636-840a-b1f5481de132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1fd15a5-a7b3-4636-840a-b1f5481de132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29a0dbd-851c-445a-9741-6a0dae30337a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Volume d6661d57-5820-4355-87f5-c162b39769e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6661d57-5820-4355-87f5-c162b39769e5', 'volume_size': 1} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1050058334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6661d57-5820-4355-87f5-c162b39769e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6539719f86b4471b02d90a98ef32975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:19:13Z,use_quota=True,user_id='650ac9b66e38434b8469af7c0c56cbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Creating volume d6661d57-5820-4355-87f5-c162b39769e5 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:19:13 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:13 devstack sudo[112522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 1073741824 Jun 26 22:19:13 devstack sudo[112522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:13 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Flow 'volume_create_manager' (1b33f01e-cd19-4316-bae1-cda04eb55849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0410ae35-82b7-4e84-af94-1a8c34230ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0410ae35-82b7-4e84-af94-1a8c34230ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1415179585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bbc213-5dac-4919-9c7d-0f72af926963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6539719f86b4471b02d90a98ef32975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:19:14Z,use_quota=True,user_id='650ac9b66e38434b8469af7c0c56cbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e5c868-359a-4995-a24d-2520ca9def58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89e5c868-359a-4995-a24d-2520ca9def58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e6b42b-df0e-4af3-a54f-7536776f69ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8e6b42b-df0e-4af3-a54f-7536776f69ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bbc213-5dac-4919-9c7d-0f72af926963', 'volume_name': 'volume-f4bbc213-5dac-4919-9c7d-0f72af926963', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb54981f-a6ba-4f5e-9ccd-b00eab414223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb54981f-a6ba-4f5e-9ccd-b00eab414223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659b111c-f11b-4932-aa22-b5896e29c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:14 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Volume f4bbc213-5dac-4919-9c7d-0f72af926963: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bbc213-5dac-4919-9c7d-0f72af926963', 'volume_size': 1} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:19:14 devstack sudo[112522]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 1073741824" returned: 0 in 1.204s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:14 devstack sudo[112528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 Jun 26 22:19:14 devstack sudo[112528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:15 devstack sudo[112528]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5" returned: 0 in 0.798s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] <== create_volume: return (2072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.521s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1415179585',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bbc213-5dac-4919-9c7d-0f72af926963,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6539719f86b4471b02d90a98ef32975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:19:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:19:14Z,use_quota=True,user_id='650ac9b66e38434b8469af7c0c56cbc3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Creating volume f4bbc213-5dac-4919-9c7d-0f72af926963 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:19:15 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a29a0dbd-851c-445a-9741-6a0dae30337a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6661d57-5820-4355-87f5-c162b39769e5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6dcd6b-03c8-49f0-ab74-281e43e390ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:15 devstack sudo[112532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 1073741824 Jun 26 22:19:15 devstack sudo[112532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Volume volume-d6661d57-5820-4355-87f5-c162b39769e5 (d6661d57-5820-4355-87f5-c162b39769e5): created successfully Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee6dcd6b-03c8-49f0-ab74-281e43e390ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Flow 'volume_create_manager' (8e81897f-0ade-4eea-94b7-7d9ce12a0b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:19:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b68b3dad-04a4-4378-b9d1-934350a693bc tempest-TestServerVolumeAttachmentScenario-2065679606 None] Created volume successfully. Jun 26 22:19:16 devstack sudo[112532]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 1073741824" returned: 0 in 1.058s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:16 devstack sudo[112538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 Jun 26 22:19:16 devstack sudo[112538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:17 devstack sudo[112538]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963" returned: 0 in 0.706s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:19:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:19:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (659b111c-f11b-4932-aa22-b5896e29c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bbc213-5dac-4919-9c7d-0f72af926963', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5972ae-df61-44af-a383-8e415ea53cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:19:17 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Volume volume-f4bbc213-5dac-4919-9c7d-0f72af926963 (f4bbc213-5dac-4919-9c7d-0f72af926963): created successfully Jun 26 22:19:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c5972ae-df61-44af-a383-8e415ea53cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:19:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Flow 'volume_create_manager' (1b33f01e-cd19-4316-bae1-cda04eb55849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:19:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1fa01d85-f2b8-4574-8e3e-304161d48e84 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Created volume successfully. Jun 26 22:19:27 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=7,cinder:UPDATE=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:19:27 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:UPDATE=8,cinder:SELECT=2,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:19:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:19:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:19:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:19:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:19:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:19:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:19:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:46 devstack sudo[112711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:19:46 devstack sudo[112711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:47 devstack sudo[112711]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.655s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:19:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:19:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:19:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:19:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-7d469bc0-df30-472f-918b-ff2b38edfc7f tempest-TestShelveInstance-119197940 None] Terminate volume connection completed successfully. Jun 26 22:19:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-7d469bc0-df30-472f-918b-ff2b38edfc7f tempest-TestShelveInstance-119197940 None] Deleting attachment 8cbd13e9-be89-4a47-8495-3faee5ecdfcc. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:19:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Acquiring lock "cinder-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:19:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Lock "cinder-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:19:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Acquiring lock "cinder-quobyte-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:19:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Lock "cinder-quobyte-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:19:53 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[97abce78-9f74-48b3-b40f-cd00bbf56f4b]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:19:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:53 devstack sudo[112763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:19:53 devstack sudo[112763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:54 devstack sudo[112763]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 0 in 0.795s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:54 devstack sudo[112769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:19:54 devstack sudo[112769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:55 devstack sudo[112769]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 1 in 0.827s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:19:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:55 devstack sudo[112778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d Jun 26 22:19:55 devstack sudo[112778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:56 devstack sudo[112778]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" returned: 0 in 0.647s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Lock "cinder-quobyte-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d" released by "delete_volume" :: held 2.335s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG cinder.quota [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Created reservations ['39d09011-b01d-4d59-a224-ca5f4da326b1', '3a3960e3-f29c-4367-b7c7-8b94bb47515a', '6a0e745f-78ec-4461-a29e-fd1e9a402c5a', '2b24343a-d284-4b58-827e-f210c2560b63'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:56 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:19:56 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:56 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.692s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG cinder.manager [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:19:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Deleted volume successfully. Jun 26 22:19:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [req-94c86a1a-1a96-4163-9b93-87a6becd01c4 req-4f939493-0c07-40f2-9ac4-b54df656edaa tempest-TestShelveInstance-119197940 None] Lock "cinder-8f0a4c6c-b3ab-4ee5-8ee2-e9402971454d-delete_volume" released by "delete_volume" :: held 3.237s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:19:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-afc1afdc-2c8b-48af-8212-e64ed7853568 req-55556d7a-af28-49b5-86cb-b515d2b4e06a tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:19:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-afc1afdc-2c8b-48af-8212-e64ed7853568 req-55556d7a-af28-49b5-86cb-b515d2b4e06a tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:19:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[583e0ee7-0cfd-4c25-8420-55e862a5de7c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:19:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-afc1afdc-2c8b-48af-8212-e64ed7853568 req-55556d7a-af28-49b5-86cb-b515d2b4e06a tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:19:58 devstack sudo[112792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 Jun 26 22:19:58 devstack sudo[112792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:19:58 devstack sudo[112792]: pam_unix(sudo:session): session closed for user root Jun 26 22:19:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-afc1afdc-2c8b-48af-8212-e64ed7853568 req-55556d7a-af28-49b5-86cb-b515d2b4e06a tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5" returned: 0 in 0.834s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:19:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-afc1afdc-2c8b-48af-8212-e64ed7853568 req-55556d7a-af28-49b5-86cb-b515d2b4e06a tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.859s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:19:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-afc1afdc-2c8b-48af-8212-e64ed7853568 req-55556d7a-af28-49b5-86cb-b515d2b4e06a tempest-TestServerVolumeAttachmentScenario-2065679606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-d6661d57-5820-4355-87f5-c162b39769e5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e63dee8e-5164-40b2-b542-84771d4ee4b0', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:19:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-afc1afdc-2c8b-48af-8212-e64ed7853568 req-55556d7a-af28-49b5-86cb-b515d2b4e06a tempest-TestServerVolumeAttachmentScenario-2065679606 None] attachment_update completed successfully. Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (d9792aff-02d4-448b-967d-5f2e33c3ccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004d6d93-d5d2-421e-a6b2-d8d22df04f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (004d6d93-d5d2-421e-a6b2-d8d22df04f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017244708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0113fe-a905-452d-a8c1-75a05a2ce42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:08Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b715edc-08a4-4766-8605-e4a0e1c7c546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b715edc-08a4-4766-8605-e4a0e1c7c546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983d4243-8c95-4f5f-970a-df6fa8d1677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (983d4243-8c95-4f5f-970a-df6fa8d1677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c0113fe-a905-452d-a8c1-75a05a2ce42c', 'volume_name': 'volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc48af7-8c5d-4678-aef2-24bd16023ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bc48af7-8c5d-4678-aef2-24bd16023ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903e89bc-fbc3-41e7-92ae-da2202be9f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:08 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume 6c0113fe-a905-452d-a8c1-75a05a2ce42c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c', 'volume_size': 1} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1017244708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c0113fe-a905-452d-a8c1-75a05a2ce42c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:08Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Creating volume 6c0113fe-a905-452d-a8c1-75a05a2ce42c {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:08 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:08 devstack sudo[113194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c 1073741824 Jun 26 22:20:08 devstack sudo[113194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:09 devstack sudo[113194]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c 1073741824" returned: 0 in 0.861s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:09 devstack sudo[113208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c Jun 26 22:20:09 devstack sudo[113208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-6843bb9d-1651-475e-b163-0ba1e8df56c0 req-09463391-f8c1-48f7-9bf0-f0e82731c8c2 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:09 devstack sudo[113208]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c" returned: 0 in 0.655s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-6843bb9d-1651-475e-b163-0ba1e8df56c0 req-09463391-f8c1-48f7-9bf0-f0e82731c8c2 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.611s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[283ae24c-d706-47c4-b741-804818c51a66]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6843bb9d-1651-475e-b163-0ba1e8df56c0 req-09463391-f8c1-48f7-9bf0-f0e82731c8c2 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (903e89bc-fbc3-41e7-92ae-da2202be9f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3bd755-77ee-41a2-935d-cf5060cbf7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:09 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c (6c0113fe-a905-452d-a8c1-75a05a2ce42c): created successfully Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e3bd755-77ee-41a2-935d-cf5060cbf7a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:09 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (d9792aff-02d4-448b-967d-5f2e33c3ccba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7d9dac34-0c25-473d-9946-a3cc774f2cbd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created volume successfully. Jun 26 22:20:09 devstack sudo[113211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 Jun 26 22:20:09 devstack sudo[113211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:10 devstack sudo[113211]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [req-6843bb9d-1651-475e-b163-0ba1e8df56c0 req-09463391-f8c1-48f7-9bf0-f0e82731c8c2 tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963" returned: 0 in 0.834s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [req-6843bb9d-1651-475e-b163-0ba1e8df56c0 req-09463391-f8c1-48f7-9bf0-f0e82731c8c2 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.854s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-6843bb9d-1651-475e-b163-0ba1e8df56c0 req-09463391-f8c1-48f7-9bf0-f0e82731c8c2 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919', 'name': 'volume-f4bbc213-5dac-4919-9c7d-0f72af926963', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '43543b7e-3236-4f77-8233-23c67569cd99', 'enforce_multipath': True} {{(pid=93616) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 26 22:20:10 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-6843bb9d-1651-475e-b163-0ba1e8df56c0 req-09463391-f8c1-48f7-9bf0-f0e82731c8c2 tempest-TestServerVolumeAttachmentScenario-2065679606 None] attachment_update completed successfully. Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (990721a6-db66-4d96-a591-d548584d82df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394b3c5d-327f-4ad0-8d24-c59fb0b70038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (394b3c5d-327f-4ad0-8d24-c59fb0b70038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2047869480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9b8238-c180-468b-b727-57c0f7e6e3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:11Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e742f94a-df7f-4311-9f48-03b96ced2873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e742f94a-df7f-4311-9f48-03b96ced2873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e136ed67-adcf-4df2-a4d9-f91304d0407a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e136ed67-adcf-4df2-a4d9-f91304d0407a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d9b8238-c180-468b-b727-57c0f7e6e3e2', 'volume_name': 'volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd729eb-12d0-42e8-89f6-4d1e840956bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfd729eb-12d0-42e8-89f6-4d1e840956bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9205a583-cfb7-468b-b6f1-1dd29c5d6027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:10 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume 9d9b8238-c180-468b-b727-57c0f7e6e3e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2', 'volume_size': 1} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2047869480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d9b8238-c180-468b-b727-57c0f7e6e3e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:11Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Creating volume 9d9b8238-c180-468b-b727-57c0f7e6e3e2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:10 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:10 devstack sudo[113252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 1073741824 Jun 26 22:20:10 devstack sudo[113252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (4107a734-2774-4aa5-9914-f7f18eb4b558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248dbc0-ef81-4052-91da-ab8e84d1dad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4248dbc0-ef81-4052-91da-ab8e84d1dad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800939128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb6dc69-42bb-4606-8617-7444963be218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:11Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec09684c-feb7-4b58-ac5d-24371798a25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec09684c-feb7-4b58-ac5d-24371798a25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e4afa9-55d8-41cf-8b71-9d4284824daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83e4afa9-55d8-41cf-8b71-9d4284824daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fb6dc69-42bb-4606-8617-7444963be218', 'volume_name': 'volume-8fb6dc69-42bb-4606-8617-7444963be218', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb26791-bd7a-4030-a40f-1dcd0f709ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bb26791-bd7a-4030-a40f-1dcd0f709ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668a4b5c-c40b-4ba6-8e44-2cd7f9647818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume 8fb6dc69-42bb-4606-8617-7444963be218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fb6dc69-42bb-4606-8617-7444963be218', 'volume_size': 1} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (f08ec2ed-5d10-4d7a-afad-0821e07babcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52900f45-9c73-450f-9390-18a8c6502a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52900f45-9c73-450f-9390-18a8c6502a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336118326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdf7e64-04ae-418d-a7e9-5fff0097fdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:11Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fe7faf-5c99-49ce-8b5d-c10a3034575c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8fe7faf-5c99-49ce-8b5d-c10a3034575c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d05101f-3c58-4dec-b7cf-55cebb937d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d05101f-3c58-4dec-b7cf-55cebb937d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfdf7e64-04ae-418d-a7e9-5fff0097fdfc', 'volume_name': 'volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548a45fc-6a34-4687-8da8-efbc8ac6e682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548a45fc-6a34-4687-8da8-efbc8ac6e682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cb94d5-20b3-4b08-b569-9aea211d4b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume cfdf7e64-04ae-418d-a7e9-5fff0097fdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc', 'volume_size': 1} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:11 devstack sudo[113252]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 1073741824" returned: 0 in 0.958s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:11 devstack sudo[113262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 Jun 26 22:20:11 devstack sudo[113262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (8fcc2506-2be2-4bb9-bafb-6a99aac78b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56b71fd-4d22-462b-b289-ea28aaa92554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e56b71fd-4d22-462b-b289-ea28aaa92554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417920316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1dece5-3697-4d84-a204-75c1319dffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:12Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa53cd1-c795-42e9-800b-cde6abb7d253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6aa53cd1-c795-42e9-800b-cde6abb7d253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f5f731-ba3c-4b0a-bb00-f80e0e0707b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61f5f731-ba3c-4b0a-bb00-f80e0e0707b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d1dece5-3697-4d84-a204-75c1319dffdc', 'volume_name': 'volume-9d1dece5-3697-4d84-a204-75c1319dffdc', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ad7eb5-d918-4a30-863f-4d906c13cc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2ad7eb5-d918-4a30-863f-4d906c13cc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13dab65-4e0e-49fc-9bd5-baca3cbf21eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:11 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume 9d1dece5-3697-4d84-a204-75c1319dffdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d1dece5-3697-4d84-a204-75c1319dffdc', 'volume_size': 1} Jun 26 22:20:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (d3f596f4-42d6-44a9-9d9b-c86997fd3dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e214eb6-8418-4a20-a5a4-2adb478cddfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e214eb6-8418-4a20-a5a4-2adb478cddfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989549915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe022320-3f40-41e6-9938-16386c057fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:12Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d21b0a-9a58-42ee-974a-938b1298f70d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06d21b0a-9a58-42ee-974a-938b1298f70d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3934bb83-f3b7-4655-bc92-14082c42c637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3934bb83-f3b7-4655-bc92-14082c42c637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe022320-3f40-41e6-9938-16386c057fcf', 'volume_name': 'volume-fe022320-3f40-41e6-9938-16386c057fcf', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f068b4c-a385-4ad7-91ec-f36ef9b0725c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f068b4c-a385-4ad7-91ec-f36ef9b0725c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a691a0-1606-4af9-8867-68bb1350dd9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume fe022320-3f40-41e6-9938-16386c057fcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe022320-3f40-41e6-9938-16386c057fcf', 'volume_size': 1} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:12 devstack sudo[113262]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2" returned: 0 in 0.744s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-800939128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fb6dc69-42bb-4606-8617-7444963be218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:11Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Creating volume 8fb6dc69-42bb-4606-8617-7444963be218 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:12 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:12 devstack sudo[113266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 1073741824 Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9205a583-cfb7-468b-b6f1-1dd29c5d6027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:12 devstack sudo[113266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1905a17f-358e-47d2-bdc1-989a81d6da4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 (9d9b8238-c180-468b-b727-57c0f7e6e3e2): created successfully Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1905a17f-358e-47d2-bdc1-989a81d6da4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (990721a6-db66-4d96-a591-d548584d82df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-986bd708-3343-4b94-8025-db2123398399 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created volume successfully. Jun 26 22:20:13 devstack sudo[113266]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 1073741824" returned: 0 in 0.851s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:13 devstack sudo[113272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 Jun 26 22:20:13 devstack sudo[113272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:14 devstack sudo[113272]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218" returned: 0 in 0.646s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.531s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-336118326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfdf7e64-04ae-418d-a7e9-5fff0097fdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:11Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Creating volume cfdf7e64-04ae-418d-a7e9-5fff0097fdfc {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:14 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:14 devstack sudo[113275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc 1073741824 Jun 26 22:20:14 devstack sudo[113275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668a4b5c-c40b-4ba6-8e44-2cd7f9647818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fb6dc69-42bb-4606-8617-7444963be218', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27e3058-ddab-420a-8e55-57218e1868b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:14 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume volume-8fb6dc69-42bb-4606-8617-7444963be218 (8fb6dc69-42bb-4606-8617-7444963be218): created successfully Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d27e3058-ddab-420a-8e55-57218e1868b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (4107a734-2774-4aa5-9914-f7f18eb4b558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:14 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-02016407-4eb0-4bb5-9930-4039af0b2826 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created volume successfully. Jun 26 22:20:15 devstack sudo[113275]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc 1073741824" returned: 0 in 0.896s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:15 devstack sudo[113282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc Jun 26 22:20:15 devstack sudo[113282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:15 devstack sudo[113282]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc" returned: 0 in 0.658s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.596s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.738s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1417920316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d1dece5-3697-4d84-a204-75c1319dffdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:12Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Creating volume 9d1dece5-3697-4d84-a204-75c1319dffdc {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:15 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:15 devstack sudo[113285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc 1073741824 Jun 26 22:20:15 devstack sudo[113285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2cb94d5-20b3-4b08-b569-9aea211d4b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703b934c-712c-45fc-9a42-249b316f3ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc (cfdf7e64-04ae-418d-a7e9-5fff0097fdfc): created successfully Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (703b934c-712c-45fc-9a42-249b316f3ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (f08ec2ed-5d10-4d7a-afad-0821e07babcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bfb26484-9738-47ea-8abd-3a26b1ee9aef tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created volume successfully. Jun 26 22:20:16 devstack sudo[113285]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc 1073741824" returned: 0 in 0.824s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:16 devstack sudo[113290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc Jun 26 22:20:16 devstack sudo[113290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-7a133190-c0b1-446d-892f-29000577f137 req-679c0e6f-afcf-4684-a2dc-ea225867f559 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Terminate volume connection completed successfully. Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-7a133190-c0b1-446d-892f-29000577f137 req-679c0e6f-afcf-4684-a2dc-ea225867f559 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Deleting attachment 43543b7e-3236-4f77-8233-23c67569cd99. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:20:17 devstack sudo[113290]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc" returned: 0 in 0.677s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.875s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-989549915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe022320-3f40-41e6-9938-16386c057fcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f100df96dbd4d258e2d1d06c27a4faa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:12Z,use_quota=True,user_id='db3821ccd79f458f9bae21f17528e098',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Creating volume fe022320-3f40-41e6-9938-16386c057fcf {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:17 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e13dab65-4e0e-49fc-9bd5-baca3cbf21eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d1dece5-3697-4d84-a204-75c1319dffdc', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e952d82-ff4f-44bf-a6a4-81729747541f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:17 devstack sudo[113298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf 1073741824 Jun 26 22:20:17 devstack sudo[113298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:17 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume volume-9d1dece5-3697-4d84-a204-75c1319dffdc (9d1dece5-3697-4d84-a204-75c1319dffdc): created successfully Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e952d82-ff4f-44bf-a6a4-81729747541f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (8fcc2506-2be2-4bb9-bafb-6a99aac78b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c9248e12-04df-490b-9b7e-26ba6d682747 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created volume successfully. Jun 26 22:20:18 devstack sudo[113298]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf 1073741824" returned: 0 in 0.839s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:18 devstack sudo[113303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf Jun 26 22:20:18 devstack sudo[113303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:18 devstack sudo[113303]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf" returned: 0 in 0.656s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15a691a0-1606-4af9-8867-68bb1350dd9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe022320-3f40-41e6-9938-16386c057fcf', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fe887b-16f7-455e-b66e-be06e0b2d7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:18 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Volume volume-fe022320-3f40-41e6-9938-16386c057fcf (fe022320-3f40-41e6-9938-16386c057fcf): created successfully Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13fe887b-16f7-455e-b66e-be06e0b2d7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Flow 'volume_create_manager' (d3f596f4-42d6-44a9-9d9b-c86997fd3dd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-62974ebb-e149-41c0-ae39-a0fcfee7460b tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created volume successfully. Jun 26 22:20:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-fe022320-3f40-41e6-9938-16386c057fcf-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-fe022320-3f40-41e6-9938-16386c057fcf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-quobyte-fe022320-3f40-41e6-9938-16386c057fcf" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:20 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-fe022320-3f40-41e6-9938-16386c057fcf" acquired by "delete_volume" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:20 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7334ba23-0ccf-48db-8d7f-1dd2e634000d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:20 devstack sudo[113330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf Jun 26 22:20:20 devstack sudo[113330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:20 devstack cinder-volume[93616]: INFO cinder.volume.manager [req-292287b9-ee3a-42d0-bb5c-23b0c0a6625c req-b0e272e9-728d-45df-bcf8-f89e6dee1bab tempest-TestServerVolumeAttachmentScenario-2065679606 None] Terminate volume connection completed successfully. Jun 26 22:20:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [req-292287b9-ee3a-42d0-bb5c-23b0c0a6625c req-b0e272e9-728d-45df-bcf8-f89e6dee1bab tempest-TestServerVolumeAttachmentScenario-2065679606 None] Deleting attachment e63dee8e-5164-40b2-b542-84771d4ee4b0. {{(pid=93616) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 26 22:20:20 devstack sudo[113330]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf" returned: 0 in 0.798s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:20 devstack sudo[113341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf Jun 26 22:20:20 devstack sudo[113341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:21 devstack sudo[113341]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-fe022320-3f40-41e6-9938-16386c057fcf" returned: 0 in 0.668s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-fe022320-3f40-41e6-9938-16386c057fcf" released by "delete_volume" :: held 1.505s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created reservations ['fb7b2ed0-66a8-4781-9b52-bb5059fcf3cb', 'd2a5ac1d-98cc-4425-b67b-537f8135ed22', '3f6ffa6d-e0ed-40e9-885a-902b67c16c69', '9919808f-8679-4b6c-8d92-6f8e9436b028'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:21 devstack sudo[113344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:21 devstack sudo[113344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-9d1dece5-3697-4d84-a204-75c1319dffdc-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-9d1dece5-3697-4d84-a204-75c1319dffdc-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-quobyte-9d1dece5-3697-4d84-a204-75c1319dffdc" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:22 devstack sudo[113344]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-9d1dece5-3697-4d84-a204-75c1319dffdc" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.652s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:22 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Deleted volume successfully. Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[42026bc9-c0ba-4d98-a9a8-65b396b3e26c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-28738dbc-ae6d-40ee-aed4-23c143700dcd tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-fe022320-3f40-41e6-9938-16386c057fcf-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:22 devstack sudo[113348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc Jun 26 22:20:22 devstack sudo[113348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:23 devstack sudo[113348]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc" returned: 0 in 0.840s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:23 devstack sudo[113353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc Jun 26 22:20:23 devstack sudo[113353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d1dece5-3697-4d84-a204-75c1319dffdc" returned: 0 in 0.682s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:23 devstack sudo[113353]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-9d1dece5-3697-4d84-a204-75c1319dffdc" released by "delete_volume" :: held 1.607s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:23 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created reservations ['3f45cf78-2d03-41e6-9809-b0683e587c6f', 'f85b9c92-b0e6-4bec-99e8-58e9b9ac0ff4', 'd16612c0-83ad-46ed-abea-6054402d5f6f', '67fba65f-1adf-4b6b-ba84-9d82d738d8ee'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:24 devstack sudo[113383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:24 devstack sudo[113383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-quobyte-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf807f70-b1e1-4d2c-bc0c-5980cdeeb2ec]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:24 devstack sudo[113400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc Jun 26 22:20:24 devstack sudo[113400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:24 devstack sudo[113383]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.823s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Deleted volume successfully. Jun 26 22:20:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-34173efa-b6a9-41bb-9eb6-e1555a106721 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-9d1dece5-3697-4d84-a204-75c1319dffdc-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:25 devstack sudo[113400]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc" returned: 0 in 0.877s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:25 devstack sudo[113412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc Jun 26 22:20:25 devstack sudo[113412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:26 devstack sudo[113412]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc" returned: 0 in 0.745s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc" released by "delete_volume" :: held 1.672s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created reservations ['3b7968d2-71dc-41ab-aa1f-7eb762f29074', '284d8944-0744-4361-88ca-ad1ed1a6212a', 'faedf846-25ba-47df-b0b0-3002fefd7c98', '52c8e4af-a198-4986-97f5-5225e734c371'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:26 devstack sudo[113418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:26 devstack sudo[113418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-8fb6dc69-42bb-4606-8617-7444963be218-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-8fb6dc69-42bb-4606-8617-7444963be218-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-quobyte-8fb6dc69-42bb-4606-8617-7444963be218" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-8fb6dc69-42bb-4606-8617-7444963be218" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acda256-0bf8-4c9b-98a1-f959026bd696]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:27 devstack sudo[113420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 Jun 26 22:20:27 devstack sudo[113420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:27 devstack sudo[113418]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.751s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:27 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:27 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Deleted volume successfully. Jun 26 22:20:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cf7b2129-a1c4-4652-8ec7-5754e6f6cf77 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-cfdf7e64-04ae-418d-a7e9-5fff0097fdfc-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:27 devstack sudo[113420]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218" returned: 0 in 0.791s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:27 devstack sudo[113426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218 Jun 26 22:20:27 devstack sudo[113426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:28 devstack sudo[113426]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8fb6dc69-42bb-4606-8617-7444963be218" returned: 0 in 0.657s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-8fb6dc69-42bb-4606-8617-7444963be218" released by "delete_volume" :: held 1.508s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created reservations ['6e7c8109-e788-4654-bc8a-cead28b8663e', '946c817f-acd5-42e0-8654-56a1c0fe004e', '231c4c0c-0256-454d-b9d2-7feaf1511254', '7df4f8d8-551e-45f2-89b8-05ee5d29c8cf'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:28 devstack sudo[113429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:28 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-9d9b8238-c180-468b-b727-57c0f7e6e3e2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-9d9b8238-c180-468b-b727-57c0f7e6e3e2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-quobyte-9d9b8238-c180-468b-b727-57c0f7e6e3e2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-9d9b8238-c180-468b-b727-57c0f7e6e3e2" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c204043f-2826-42ed-8287-8869cee21064]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:29 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.702s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Deleted volume successfully. Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-3b29bc64-6385-4ca2-a856-85cc99f4061c tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-8fb6dc69-42bb-4606-8617-7444963be218-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:29 devstack sudo[113433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 Jun 26 22:20:29 devstack sudo[113433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:29 devstack sudo[113433]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2" returned: 0 in 0.730s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:29 devstack sudo[113438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2 Jun 26 22:20:29 devstack sudo[113438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:30 devstack sudo[113438]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9d9b8238-c180-468b-b727-57c0f7e6e3e2" returned: 0 in 0.670s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-9d9b8238-c180-468b-b727-57c0f7e6e3e2" released by "delete_volume" :: held 1.448s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created reservations ['ccbb2a63-30ba-4fef-8290-917bcc821150', 'c8090eab-4258-442e-ab6d-8e5f35059981', '597bcab9-910d-4e5a-b0fb-465670aea37c', '115984ae-0bb4-452e-b6aa-32e4e6ae2088'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:30 devstack sudo[113441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:30 devstack sudo[113441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-6c0113fe-a905-452d-a8c1-75a05a2ce42c-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-6c0113fe-a905-452d-a8c1-75a05a2ce42c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "cinder-f4bbc213-5dac-4919-9c7d-0f72af926963-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-f4bbc213-5dac-4919-9c7d-0f72af926963-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:31 devstack sudo[113441]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.707s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "cinder-quobyte-6c0113fe-a905-452d-a8c1-75a05a2ce42c" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Deleted volume successfully. Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-6c0113fe-a905-452d-a8c1-75a05a2ce42c" acquired by "delete_volume" :: waited 0.025s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7b6a219a-f811-4159-93cb-7ed53edbc5b6 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-9d9b8238-c180-468b-b727-57c0f7e6e3e2-delete_volume" released by "delete_volume" :: held 2.418s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "cinder-quobyte-f4bbc213-5dac-4919-9c7d-0f72af926963" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7282f46-0fbb-4d3e-9581-56134d94b4a3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-quobyte-f4bbc213-5dac-4919-9c7d-0f72af926963" acquired by "delete_volume" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a22947a-952f-41c3-934b-4c593cc10e9b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:31 devstack sudo[113444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c Jun 26 22:20:31 devstack sudo[113444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:31 devstack sudo[113445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 Jun 26 22:20:31 devstack sudo[113445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:32 devstack sudo[113444]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c" returned: 0 in 0.763s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:32 devstack sudo[113454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c Jun 26 22:20:32 devstack sudo[113454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:32 devstack sudo[113445]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963" returned: 0 in 0.786s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:32 devstack sudo[113456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963 Jun 26 22:20:32 devstack sudo[113456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:32 devstack sudo[113454]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-6c0113fe-a905-452d-a8c1-75a05a2ce42c" returned: 0 in 0.634s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-quobyte-6c0113fe-a905-452d-a8c1-75a05a2ce42c" released by "delete_volume" :: held 1.440s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Created reservations ['ea73be84-d654-400a-a31a-ed457cea8ec7', '9a7116cc-97b7-4cc0-8be6-52535402a990', 'ee3946df-5bd2-471a-a53f-b687eff07152', 'c54d336b-41c7-4a14-961d-71f3562e495b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:32 devstack sudo[113456]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f4bbc213-5dac-4919-9c7d-0f72af926963" returned: 0 in 0.672s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-quobyte-f4bbc213-5dac-4919-9c7d-0f72af926963" released by "delete_volume" :: held 1.505s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:33 devstack sudo[113460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:33 devstack sudo[113460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Created reservations ['c6ccde3d-f39f-45d5-8072-77e88d44f3da', '6e554c09-c3a1-40b3-baab-9f206efd37ea', '251e63e7-21d1-4960-a4be-56b59b3f541f', 'a68e55b6-3706-45d8-b714-b37a93d26a12'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:33 devstack sudo[113462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:33 devstack sudo[113462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "cinder-d6661d57-5820-4355-87f5-c162b39769e5-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-d6661d57-5820-4355-87f5-c162b39769e5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "cinder-quobyte-d6661d57-5820-4355-87f5-c162b39769e5" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:33 devstack sudo[113460]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-quobyte-d6661d57-5820-4355-87f5-c162b39769e5" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.732s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Deleted volume successfully. Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f86011d-b8dc-4e7d-806f-fb79f65c2364]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0bb8d95c-cbd6-40df-ad98-c19046908b78 tempest-CreateVolumesFromSourceVolumeTest-737222559 None] Lock "cinder-6c0113fe-a905-452d-a8c1-75a05a2ce42c-delete_volume" released by "delete_volume" :: held 2.483s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:33 devstack sudo[113462]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.742s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Deleted volume successfully. Jun 26 22:20:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-19e5d4ca-1ddf-4395-8b2b-f3ea3cb0b650 tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-f4bbc213-5dac-4919-9c7d-0f72af926963-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:33 devstack sudo[113467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 Jun 26 22:20:33 devstack sudo[113467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:34 devstack sudo[113467]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5" returned: 0 in 0.852s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:34 devstack sudo[113472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5 Jun 26 22:20:34 devstack sudo[113472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:35 devstack sudo[113472]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d6661d57-5820-4355-87f5-c162b39769e5" returned: 0 in 0.709s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-quobyte-d6661d57-5820-4355-87f5-c162b39769e5" released by "delete_volume" :: held 1.617s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Created reservations ['1fe1e8ab-fdac-4c8d-b950-af4d4418d63e', '5a31081c-fe9f-4f9c-a302-f8a4da111c34', '0600e58d-3e2c-418b-a466-2ae68ca22565', 'b6d48240-59ef-4e99-b71a-5bce04b95a6d'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:35 devstack sudo[113476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:35 devstack sudo[113476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:36 devstack sudo[113476]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.738s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:36 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Deleted volume successfully. Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-369d95f2-4dee-4605-8a07-f749b36bfaed tempest-TestServerVolumeAttachmentScenario-2065679606 None] Lock "cinder-d6661d57-5820-4355-87f5-c162b39769e5-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Flow 'volume_create_manager' (8795f8a8-0ccc-463b-a2d0-4800835cc4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca964921-7c17-47b1-b559-f52079beab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca964921-7c17-47b1-b559-f52079beab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-737269803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff3c65e-47d9-4f6e-8898-04191db40040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5dc4c8b04ce4bcf877abe33e0a40621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:37Z,use_quota=True,user_id='cb71e5809dac4281b28eafa2fc8d03bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce7ea40-6c41-470f-b31d-53369f8ac37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce7ea40-6c41-470f-b31d-53369f8ac37d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff345ea-057d-4c41-a0a8-23044d767b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ff345ea-057d-4c41-a0a8-23044d767b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cff3c65e-47d9-4f6e-8898-04191db40040', 'volume_name': 'volume-cff3c65e-47d9-4f6e-8898-04191db40040', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6c6428-383d-457c-8d45-2c9663c75ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b6c6428-383d-457c-8d45-2c9663c75ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab05f06-1408-43ad-a1f0-fe328c2252d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:36 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Volume cff3c65e-47d9-4f6e-8898-04191db40040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cff3c65e-47d9-4f6e-8898-04191db40040', 'volume_size': 1} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-737269803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cff3c65e-47d9-4f6e-8898-04191db40040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5dc4c8b04ce4bcf877abe33e0a40621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:37Z,use_quota=True,user_id='cb71e5809dac4281b28eafa2fc8d03bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Creating volume cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:36 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:36 devstack sudo[113479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 1073741824 Jun 26 22:20:36 devstack sudo[113479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:37 devstack sudo[113479]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 1073741824" returned: 0 in 0.947s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:37 devstack sudo[113487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 Jun 26 22:20:37 devstack sudo[113487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:38 devstack sudo[113487]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040" returned: 0 in 0.705s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab05f06-1408-43ad-a1f0-fe328c2252d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cff3c65e-47d9-4f6e-8898-04191db40040', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9278a8-d9ba-479d-a5b0-869c24294b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:38 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Volume volume-cff3c65e-47d9-4f6e-8898-04191db40040 (cff3c65e-47d9-4f6e-8898-04191db40040): created successfully Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9278a8-d9ba-479d-a5b0-869c24294b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Flow 'volume_create_manager' (8795f8a8-0ccc-463b-a2d0-4800835cc4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4f14e1f9-1b9f-4d1f-9d39-17dbd3028d2b tempest-VolumeDependencyTests-2087032542 None] Created volume successfully. Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Creating offline snapshot 6831e51b-76ac-49f1-a98a-8600b8c37697 of volume cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:20:39 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[350ca6e4-e915-484b-b1a4-84f2a23717fd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:39 devstack sudo[113490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 Jun 26 22:20:39 devstack sudo[113490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:39 devstack sudo[113490]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040" returned: 0 in 0.848s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:39 devstack sudo[113497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 1G Jun 26 22:20:39 devstack sudo[113497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:40 devstack sudo[113497]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 1G" returned: 0 in 0.868s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff3c65e-47d9-4f6e-8898-04191db40040 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:40 devstack sudo[113503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff3c65e-47d9-4f6e-8898-04191db40040 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 Jun 26 22:20:40 devstack sudo[113503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:41 devstack sudo[113503]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cff3c65e-47d9-4f6e-8898-04191db40040 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697" returned: 0 in 0.756s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:41 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 is being set with open permissions: ugo+rw Jun 26 22:20:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:41 devstack sudo[113509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 Jun 26 22:20:41 devstack sudo[113509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:42 devstack sudo[113509]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697" returned: 0 in 0.721s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:42 devstack sudo[113512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.info Jun 26 22:20:42 devstack sudo[113512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:42 devstack sudo[113512]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.info" returned: 0 in 0.728s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:43 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.info is being set with open permissions: ugo+rw Jun 26 22:20:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:43 devstack sudo[113515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.info Jun 26 22:20:43 devstack sudo[113515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:43 devstack sudo[113515]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.info" returned: 0 in 0.763s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.791s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-998ab1e1-4823-47e8-bc39-b675fe73d38b tempest-VolumeDependencyTests-2087032542 None] Create snapshot completed successfully Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Flow 'volume_create_manager' (d650f092-8045-4f1d-8c7e-16895960966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78de3d2-41d7-49fd-a77b-1e03437280d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78de3d2-41d7-49fd-a77b-1e03437280d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1009637342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=597b902c-1c6b-4790-a93f-2f4cc3616c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5dc4c8b04ce4bcf877abe33e0a40621',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6831e51b-76ac-49f1-a98a-8600b8c37697,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:45Z,use_quota=True,user_id='cb71e5809dac4281b28eafa2fc8d03bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379793b5-d5b3-43d0-aedf-51175e7c3652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379793b5-d5b3-43d0-aedf-51175e7c3652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50c76f7-4721-44d8-a5bb-e53fddf048d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50c76f7-4721-44d8-a5bb-e53fddf048d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '597b902c-1c6b-4790-a93f-2f4cc3616c92', 'volume_name': 'volume-597b902c-1c6b-4790-a93f-2f4cc3616c92', 'volume_size': 1, 'snapshot_id': '6831e51b-76ac-49f1-a98a-8600b8c37697'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86020308-4c2f-499a-9b8d-60267db1403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86020308-4c2f-499a-9b8d-60267db1403f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0a11e9-e5c9-445f-8ca7-70835b49cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:44 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Volume 597b902c-1c6b-4790-a93f-2f4cc3616c92: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-597b902c-1c6b-4790-a93f-2f4cc3616c92', 'volume_size': 1, 'snapshot_id': '6831e51b-76ac-49f1-a98a-8600b8c37697'} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-quobyte-6831e51b-76ac-49f1-a98a-8600b8c37697-597b902c-1c6b-4790-a93f-2f4cc3616c92" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-6831e51b-76ac-49f1-a98a-8600b8c37697-597b902c-1c6b-4790-a93f-2f4cc3616c92" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Creating volume 597b902c-1c6b-4790-a93f-2f4cc3616c92 from snapshot 6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-quobyte-597b902c-1c6b-4790-a93f-2f4cc3616c92" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-597b902c-1c6b-4790-a93f-2f4cc3616c92" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] snapshot: 6831e51b-76ac-49f1-a98a-8600b8c37697, volume: 597b902c-1c6b-4790-a93f-2f4cc3616c92, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dbcc02-5805-46da-8ae3-22aed5d9f2a6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:45 devstack sudo[113526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 Jun 26 22:20:45 devstack sudo[113526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:45 devstack sudo[113526]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697" returned: 0 in 0.831s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff3c65e-47d9-4f6e-8898-04191db40040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[48244bd0-e6ec-433e-9727-220eb28239cf]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:46 devstack sudo[113531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 Jun 26 22:20:46 devstack sudo[113531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:46 devstack sudo[113533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:20:46 devstack sudo[113533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:46 devstack sudo[113531]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040" returned: 0 in 0.856s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:20:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:46 devstack sudo[113538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 Jun 26 22:20:46 devstack sudo[113538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:47 devstack sudo[113533]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (bf798df6-b6e8-4bc9-a53f-4465b9d70a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5330f067-df08-45fd-8e7a-73206bb7d9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.833s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5330f067-df08-45fd-8e7a-73206bb7d9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076238385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:47Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268d9d29-1187-4375-816d-af86977f5c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (268d9d29-1187-4375-816d-af86977f5c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4ef329-a247-4b46-a662-2d97c06c5743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d4ef329-a247-4b46-a662-2d97c06c5743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2', 'volume_name': 'volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3288e5a8-633b-499c-af92-eef7d31406fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3288e5a8-633b-499c-af92-eef7d31406fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ef3ed5-eabc-4058-be0d-e2f338d76446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Volume cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2', 'volume_size': 1} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (d637615d-a349-4562-8d3c-538b939df9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa8130f-e703-4676-a98d-3ab705ec2b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa8130f-e703-4676-a98d-3ab705ec2b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1481099150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c4a4c4-f4fd-481c-94d8-132cd193b2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:47Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873bf77c-ad3e-40cc-bd10-201b6bf80737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (873bf77c-ad3e-40cc-bd10-201b6bf80737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae871f4b-221b-43d7-bba2-7bb0987189fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae871f4b-221b-43d7-bba2-7bb0987189fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7c4a4c4-f4fd-481c-94d8-132cd193b2fa', 'volume_name': 'volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc44a10-4570-4210-97bb-80f87742fa1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc44a10-4570-4210-97bb-80f87742fa1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fef8816-89f7-4c93-8685-0e7ec108727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:47 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Volume a7c4a4c4-f4fd-481c-94d8-132cd193b2fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa', 'volume_size': 1} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=84,cinder:UPDATE=105,cinder:INSERT=20,cinder:DELETE=10 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=78,cinder:INSERT=24,cinder:UPDATE=94,cinder:DELETE=7 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:20:47 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (2a857f2d-4a96-453e-859a-a4e823f55acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ebb9a0-96a7-40e5-b4e2-44ec2636ff2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ebb9a0-96a7-40e5-b4e2-44ec2636ff2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-352623957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7e6b2c-f8b3-473d-8852-87991cb4116b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:48Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faa59fc-2113-453c-97bc-e94f1aa14b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0faa59fc-2113-453c-97bc-e94f1aa14b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72947b1f-b211-4d90-bc1d-07bf267e9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72947b1f-b211-4d90-bc1d-07bf267e9610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e7e6b2c-f8b3-473d-8852-87991cb4116b', 'volume_name': 'volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8a50df-308d-446f-9400-9bdfbb6afa36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8a50df-308d-446f-9400-9bdfbb6afa36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947f9942-3baf-47cb-9462-e74f7e6db20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:48 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Volume 4e7e6b2c-f8b3-473d-8852-87991cb4116b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b', 'volume_size': 1} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (854c6640-31f4-4c06-887f-8ed95459ac85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72974dfe-67db-46c5-af75-d45753d71284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72974dfe-67db-46c5-af75-d45753d71284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908499539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa212093-5daf-4372-bcbb-3bfb5fd98ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:49Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da11f4-c5a3-4d03-bf32-226f1622a53a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93da11f4-c5a3-4d03-bf32-226f1622a53a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cb48ac-9137-4625-aec7-6f4822254f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cb48ac-9137-4625-aec7-6f4822254f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa212093-5daf-4372-bcbb-3bfb5fd98ec5', 'volume_name': 'volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b3b5a0-acf4-47d5-891a-563f6e2020bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b3b5a0-acf4-47d5-891a-563f6e2020bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cafa7aa-4a8b-43f4-8c1c-383d4a37c8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Volume aa212093-5daf-4372-bcbb-3bfb5fd98ec5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5', 'volume_size': 1} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (70f49388-6eb2-435d-b63c-bcf569b14127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1767afa-e6c1-439a-9d74-637b26fb69da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1767afa-e6c1-439a-9d74-637b26fb69da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1476082503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c89b2a2-60b7-4bfe-90ee-c47f585e03f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:50Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad537b86-b724-4523-b3c6-50b00bdea780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad537b86-b724-4523-b3c6-50b00bdea780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f6d509-63f7-460f-85fc-147dc68ddc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f6d509-63f7-460f-85fc-147dc68ddc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c89b2a2-60b7-4bfe-90ee-c47f585e03f7', 'volume_name': 'volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac283bc9-3f9a-4076-b176-0b9cb3c3d261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac283bc9-3f9a-4076-b176-0b9cb3c3d261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67272b09-6d06-4f3d-940b-567036cc87ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:49 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Volume 2c89b2a2-60b7-4bfe-90ee-c47f585e03f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7', 'volume_size': 1} Jun 26 22:20:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:52 devstack sudo[113538]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92" returned: 0 in 5.324s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12f7596-1c5a-45af-8532-ed7cf378fe56]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:52 devstack sudo[113552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 Jun 26 22:20:52 devstack sudo[113552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:53 devstack sudo[113552]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040" returned: 0 in 0.909s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040, size 1024.00 MB, duration 5.32 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:20:53 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Converted 1024.00 MB image at 192.31 MB/s Jun 26 22:20:53 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 is being set with open permissions: ugo+rw Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:53 devstack sudo[113557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 Jun 26 22:20:53 devstack sudo[113557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:53 devstack sudo[113557]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92" returned: 0 in 0.623s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-597b902c-1c6b-4790-a93f-2f4cc3616c92" released by "_copy_volume_from_snapshot" :: held 8.652s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-6831e51b-76ac-49f1-a98a-8600b8c37697-597b902c-1c6b-4790-a93f-2f4cc3616c92" released by "_create_volume_from_snapshot" :: held 8.683s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.699s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.423s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2076238385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:47Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Creating volume cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:53 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:53 devstack sudo[113560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 1073741824 Jun 26 22:20:53 devstack sudo[113560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f0a11e9-e5c9-445f-8ca7-70835b49cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-597b902c-1c6b-4790-a93f-2f4cc3616c92', 'volume_size': 1, 'snapshot_id': '6831e51b-76ac-49f1-a98a-8600b8c37697'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec3ed70-f253-44f7-bd1d-59f8921a39a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:53 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Volume volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 (597b902c-1c6b-4790-a93f-2f4cc3616c92): created successfully Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bec3ed70-f253-44f7-bd1d-59f8921a39a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:53 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Flow 'volume_create_manager' (d650f092-8045-4f1d-8c7e-16895960966a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-04059a9e-02b6-4351-b7b8-2491e2271d0c tempest-VolumeDependencyTests-2087032542 None] Created volume successfully. Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-6831e51b-76ac-49f1-a98a-8600b8c37697-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-6831e51b-76ac-49f1-a98a-8600b8c37697-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-quobyte-cff3c65e-47d9-4f6e-8898-04191db40040" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-cff3c65e-47d9-4f6e-8898-04191db40040" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-quobyte-6831e51b-76ac-49f1-a98a-8600b8c37697" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-6831e51b-76ac-49f1-a98a-8600b8c37697" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Deleting offline snapshot 6831e51b-76ac-49f1-a98a-8600b8c37697 of volume cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] snapshot_file for this snap is: volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48a8716-ed56-493f-b72e-d538fdb8c1d7]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:54 devstack sudo[113563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 Jun 26 22:20:54 devstack sudo[113563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:54 devstack sudo[113560]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 1073741824" returned: 0 in 0.829s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:54 devstack sudo[113567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 Jun 26 22:20:54 devstack sudo[113567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:55 devstack sudo[113563]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697" returned: 0 in 0.808s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cff3c65e-47d9-4f6e-8898-04191db40040(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0703efd-f510-4610-a4ec-935b94afbc54]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:55 devstack sudo[113573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 Jun 26 22:20:55 devstack sudo[113573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:55 devstack sudo[113567]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2" returned: 0 in 0.695s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.663s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1481099150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7c4a4c4-f4fd-481c-94d8-132cd193b2fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:47Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Creating volume a7c4a4c4-f4fd-481c-94d8-132cd193b2fa {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:55 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ef3ed5-eabc-4058-be0d-e2f338d76446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b502cb4c-2803-4ceb-b65d-81769d553e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:55 devstack sudo[113576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa 1073741824 Jun 26 22:20:55 devstack sudo[113576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:55 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Volume volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 (cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2): created successfully Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b502cb4c-2803-4ceb-b65d-81769d553e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (bf798df6-b6e8-4bc9-a53f-4465b9d70a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:55 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ff296c0a-df19-460f-b278-0f4f874fde28 tempest-CreateVolumesFromImageTest-1184502417 None] Created volume successfully. Jun 26 22:20:55 devstack sudo[113573]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040" returned: 0 in 0.775s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:55 devstack sudo[113584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 Jun 26 22:20:55 devstack sudo[113584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:56 devstack sudo[113576]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa 1073741824" returned: 0 in 0.836s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:56 devstack sudo[113586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa Jun 26 22:20:56 devstack sudo[113586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:56 devstack sudo[113584]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697" returned: 0 in 0.769s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:56 devstack sudo[113591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697 Jun 26 22:20:56 devstack sudo[113591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:56 devstack sudo[113586]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa" returned: 0 in 0.680s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.595s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-352623957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e7e6b2c-f8b3-473d-8852-87991cb4116b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:48Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Creating volume 4e7e6b2c-f8b3-473d-8852-87991cb4116b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:56 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:56 devstack sudo[113594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b 1073741824 Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fef8816-89f7-4c93-8685-0e7ec108727b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:56 devstack sudo[113594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff13e6e0-8e15-47d6-9442-43b5c060bc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:56 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Volume volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa (a7c4a4c4-f4fd-481c-94d8-132cd193b2fa): created successfully Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff13e6e0-8e15-47d6-9442-43b5c060bc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:56 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (d637615d-a349-4562-8d3c-538b939df9e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-81672cd7-2e32-44b0-b090-4e6bbcc0afd3 tempest-CreateVolumesFromImageTest-1184502417 None] Created volume successfully. Jun 26 22:20:57 devstack sudo[113591]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040.6831e51b-76ac-49f1-a98a-8600b8c37697" returned: 0 in 0.685s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-6831e51b-76ac-49f1-a98a-8600b8c37697" released by "_delete_snapshot" :: held 3.133s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-cff3c65e-47d9-4f6e-8898-04191db40040" released by "delete_snapshot" :: held 3.157s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:57 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Created reservations ['578b92c7-2cfe-40e6-a972-2dd7ce642fb4', 'e3febdad-41db-4967-9eec-9d2048ead679', '363690e1-2910-472f-ab43-78a1896f1ba1', 'b98f297f-4249-40b5-b7cc-b84c208bcdb7'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:20:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Delete snapshot completed successfully. Jun 26 22:20:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-14683614-5f7a-48fe-94b6-695e97e2693d tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-6831e51b-76ac-49f1-a98a-8600b8c37697-delete_snapshot" released by "delete_snapshot" :: held 3.296s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:20:57 devstack sudo[113594]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b 1073741824" returned: 0 in 0.846s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:57 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b Jun 26 22:20:57 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:58 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-cff3c65e-47d9-4f6e-8898-04191db40040-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b" returned: 0 in 0.681s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.571s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.225s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1908499539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa212093-5daf-4372-bcbb-3bfb5fd98ec5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:49Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Creating volume aa212093-5daf-4372-bcbb-3bfb5fd98ec5 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:58 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (947f9942-3baf-47cb-9462-e74f7e6db20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06ec74-3921-4012-b1df-425cc5e16c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:20:58 devstack sudo[113604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 1073741824 Jun 26 22:20:58 devstack sudo[113604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-cff3c65e-47d9-4f6e-8898-04191db40040-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:58 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Volume volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b (4e7e6b2c-f8b3-473d-8852-87991cb4116b): created successfully Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a06ec74-3921-4012-b1df-425cc5e16c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (2a857f2d-4a96-453e-859a-a4e823f55acd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:20:58 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-12058e84-b8d2-49fa-8a63-402c56706544 tempest-CreateVolumesFromImageTest-1184502417 None] Created volume successfully. Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-quobyte-cff3c65e-47d9-4f6e-8898-04191db40040" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-cff3c65e-47d9-4f6e-8898-04191db40040" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd7a9d4-6dcd-4181-ab1b-691a8780989d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:20:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:58 devstack sudo[113606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 Jun 26 22:20:58 devstack sudo[113606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:59 devstack sudo[113604]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 1073741824" returned: 0 in 0.839s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:59 devstack sudo[113615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 Jun 26 22:20:59 devstack sudo[113615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:59 devstack sudo[113606]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040" returned: 0 in 0.836s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:59 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040 Jun 26 22:20:59 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:20:59 devstack sudo[113615]: pam_unix(sudo:session): session closed for user root Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5" returned: 0 in 0.661s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.944s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1476082503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c89b2a2-60b7-4bfe-90ee-c47f585e03f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b723da1467224b9fbd0d58cb867a5c5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:20:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:20:50Z,use_quota=True,user_id='259cb88d644f41fd968408f6bcb768c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Creating volume 2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:20:59 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:20:59 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cafa7aa-4a8b-43f4-8c1c-383d4a37c8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:20:59 devstack sudo[113621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 1073741824 Jun 26 22:21:00 devstack sudo[113621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddcca4d-9625-4962-b985-c8837955b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:00 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Volume volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 (aa212093-5daf-4372-bcbb-3bfb5fd98ec5): created successfully Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ddcca4d-9625-4962-b985-c8837955b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (854c6640-31f4-4c06-887f-8ed95459ac85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:00 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c911875f-91d3-470f-b88e-9396b8d2984d tempest-CreateVolumesFromImageTest-1184502417 None] Created volume successfully. Jun 26 22:21:00 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cff3c65e-47d9-4f6e-8898-04191db40040" returned: 0 in 0.683s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-cff3c65e-47d9-4f6e-8898-04191db40040" released by "delete_volume" :: held 1.583s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Created reservations ['70fb3efd-a2cf-494f-b19f-98bf5edf7766', '4ac3a804-9dc1-42bb-be2e-7c7004f3c199', '89ea1761-c905-4e36-902c-d9bb1d6c9169', 'dc5909de-073d-4a5d-a8c8-e214d7e093aa'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:00 devstack sudo[113623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:00 devstack sudo[113623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-597b902c-1c6b-4790-a93f-2f4cc3616c92-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-597b902c-1c6b-4790-a93f-2f4cc3616c92-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "cinder-quobyte-597b902c-1c6b-4790-a93f-2f4cc3616c92" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-597b902c-1c6b-4790-a93f-2f4cc3616c92" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5aa809-44f9-4a86-b296-4f4e1747e7ac]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:00 devstack sudo[113628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 Jun 26 22:21:00 devstack sudo[113628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:00 devstack sudo[113621]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:00 devstack sudo[113623]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 1073741824" returned: 0 in 0.953s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.719s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:00 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Deleted volume successfully. Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de36c815-da37-4b10-a47c-9ec88debb2a0 tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-cff3c65e-47d9-4f6e-8898-04191db40040-delete_volume" released by "delete_volume" :: held 2.528s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:00 devstack sudo[113631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 Jun 26 22:21:00 devstack sudo[113631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:01 devstack sudo[113628]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92" returned: 0 in 0.817s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:01 devstack sudo[113637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92 Jun 26 22:21:01 devstack sudo[113637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:01 devstack sudo[113631]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7" returned: 0 in 0.668s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.702s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67272b09-6d06-4f3d-940b-567036cc87ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d605e42-6542-46b1-bbf1-a41102ccb832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:01 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Volume volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 (2c89b2a2-60b7-4bfe-90ee-c47f585e03f7): created successfully Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d605e42-6542-46b1-bbf1-a41102ccb832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Flow 'volume_create_manager' (70f49388-6eb2-435d-b63c-bcf569b14127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:01 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-37fc6b5f-a4d1-4264-b0e6-07bc843f2ccb tempest-CreateVolumesFromImageTest-1184502417 None] Created volume successfully. Jun 26 22:21:02 devstack sudo[113637]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-597b902c-1c6b-4790-a93f-2f4cc3616c92" returned: 0 in 0.663s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-quobyte-597b902c-1c6b-4790-a93f-2f4cc3616c92" released by "delete_volume" :: held 1.520s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Created reservations ['0000870d-a993-4629-967f-74d46ab896c1', '02fbf3a6-3dfb-482d-a883-7af41829a710', '8711b59a-d3fa-4d29-8dd9-9ba0caa93aac', '2437a665-60cf-4329-97f3-b244274e2b2b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:02 devstack sudo[113640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:02 devstack sudo[113640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-quobyte-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6544f062-6214-4da6-8c8f-bf3caac29382]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:02 devstack sudo[113642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 Jun 26 22:21:02 devstack sudo[113642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:03 devstack sudo[113640]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.696s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:03 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Deleted volume successfully. Jun 26 22:21:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-72066d05-aadf-42f7-952f-240c038ad53b tempest-VolumeDependencyTests-2087032542 None] Lock "cinder-597b902c-1c6b-4790-a93f-2f4cc3616c92-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7" returned: 0 in 0.837s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:03 devstack sudo[113642]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:03 devstack sudo[113648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7 Jun 26 22:21:03 devstack sudo[113648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:04 devstack sudo[113648]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7" returned: 0 in 0.716s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7" released by "delete_volume" :: held 1.604s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Created reservations ['92d61e89-e538-4214-ad56-e4944a752f6b', 'a6f38f9b-c563-426a-8f44-5614fbb43058', '653bee80-1f2e-4229-a4e3-7f2b5f9d7d89', 'b98b03bf-a351-4cc2-b8ea-26ec58f69f00'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:04 devstack sudo[113652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:04 devstack sudo[113652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:04 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-aa212093-5daf-4372-bcbb-3bfb5fd98ec5-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-aa212093-5daf-4372-bcbb-3bfb5fd98ec5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-quobyte-aa212093-5daf-4372-bcbb-3bfb5fd98ec5" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-aa212093-5daf-4372-bcbb-3bfb5fd98ec5" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b7cb9c-f8db-4508-8177-162d79c9e6fe]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:05 devstack sudo[113652]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.658s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:05 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Deleted volume successfully. Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-9bc8fcba-16e4-46f9-affd-702febfddd84 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-2c89b2a2-60b7-4bfe-90ee-c47f585e03f7-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:05 devstack sudo[113656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 Jun 26 22:21:05 devstack sudo[113656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:05 devstack sudo[113656]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5" returned: 0 in 0.810s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:05 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:05 devstack sudo[113661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5 Jun 26 22:21:05 devstack sudo[113661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:06 devstack sudo[113661]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-aa212093-5daf-4372-bcbb-3bfb5fd98ec5" returned: 0 in 0.754s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-aa212093-5daf-4372-bcbb-3bfb5fd98ec5" released by "delete_volume" :: held 1.614s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Created reservations ['699cc74d-557b-4567-b7ba-9fbd715601b9', 'dac028d1-a892-4535-bc0c-74fa9799eaad', '1c7ea741-6c2f-432d-adae-3ef378791f7a', '151f515d-6918-40e3-a4da-51f574b7150b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:06 devstack sudo[113664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:06 devstack sudo[113664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-4e7e6b2c-f8b3-473d-8852-87991cb4116b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-4e7e6b2c-f8b3-473d-8852-87991cb4116b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-quobyte-4e7e6b2c-f8b3-473d-8852-87991cb4116b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-4e7e6b2c-f8b3-473d-8852-87991cb4116b" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[64552c33-235f-479a-9a23-a03c39747c21]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:07 devstack sudo[113666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b Jun 26 22:21:07 devstack sudo[113666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:07 devstack sudo[113664]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.761s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:07 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Deleted volume successfully. Jun 26 22:21:07 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-cb11f2d2-5887-4efe-85ae-0af40d1d6521 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-aa212093-5daf-4372-bcbb-3bfb5fd98ec5-delete_volume" released by "delete_volume" :: held 2.623s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:08 devstack sudo[113666]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b" returned: 0 in 0.808s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:08 devstack sudo[113672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b Jun 26 22:21:08 devstack sudo[113672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:08 devstack sudo[113672]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-4e7e6b2c-f8b3-473d-8852-87991cb4116b" returned: 0 in 0.755s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:08 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-4e7e6b2c-f8b3-473d-8852-87991cb4116b" released by "delete_volume" :: held 1.618s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Created reservations ['c35a3330-15ba-4967-8a9b-63208c71ecbb', '5eb7381d-c877-4c78-bf94-058fb9684c98', '0d053ff1-22c6-40bb-9630-0ed4229dce88', 'a24fcf84-4821-4e78-a269-7fdd84deccee'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:09 devstack sudo[113675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:09 devstack sudo[113675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-quobyte-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ddc9ba-8d08-4fa2-937b-bab8b331e3ba]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:09 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa Jun 26 22:21:09 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:09 devstack sudo[113675]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.687s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Deleted volume successfully. Jun 26 22:21:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-574b47e9-8338-4f94-89e3-83102cb5a7e5 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-4e7e6b2c-f8b3-473d-8852-87991cb4116b-delete_volume" released by "delete_volume" :: held 2.552s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:10 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa" returned: 0 in 0.921s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:10 devstack sudo[113718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa Jun 26 22:21:10 devstack sudo[113718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:11 devstack sudo[113718]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa" returned: 0 in 0.756s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa" released by "delete_volume" :: held 1.730s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Created reservations ['1e709010-f714-49da-867e-7d9c5aeafc90', '01243944-28c8-45d1-a845-e69d682ca85a', 'ac82a256-0429-4adb-9aa7-5ecc0f926bf8', '56887df3-b7c5-4d6e-a118-2ab732aaba14'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:11 devstack sudo[113723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:11 devstack sudo[113723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "cinder-quobyte-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2" acquired by "delete_volume" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[649a17b5-55d4-4558-9729-58c56d34d2a1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:12 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 Jun 26 22:21:12 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:12 devstack sudo[113723]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.896s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:12 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:12 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Deleted volume successfully. Jun 26 22:21:12 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-2c84fbbc-1ea9-43e4-aa82-6b34c1ea4865 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-a7c4a4c4-f4fd-481c-94d8-132cd193b2fa-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:12 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2" returned: 0 in 0.880s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:12 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2 Jun 26 22:21:12 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:13 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2" returned: 0 in 0.712s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-quobyte-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2" released by "delete_volume" :: held 1.667s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Created reservations ['beb0b75b-cbb9-49d1-b451-d36ef8a964c4', 'ff492bcd-9aa5-49ce-a6f3-7a485c313e3e', 'cd608517-f18a-467d-bfee-4e0be19744b2', '0860da5c-6297-40c1-8d81-574a561ea11b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:13 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:13 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:14 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.848s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:14 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:14 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Deleted volume successfully. Jun 26 22:21:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a3a9015b-9a61-4d05-be7a-448a97cdd516 tempest-CreateVolumesFromImageTest-1184502417 None] Lock "cinder-cfa7a478-8ad6-49ca-9c60-fc9f3f120ba2-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Flow 'volume_create_manager' (cd13bb8c-c709-45c7-a6f6-8fef538f84db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15fc653-18bb-402f-817e-a2a63b781fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15fc653-18bb-402f-817e-a2a63b781fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fcb361-3833-43b2-823f-856ec34500b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ca07512b4145f5b65272c778602cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:21:21Z,use_quota=True,user_id='cc1480dd535b460cb152c636659591a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b3d498-d5db-409c-b42b-1b18b1fd84b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b3d498-d5db-409c-b42b-1b18b1fd84b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e28e5-5ca3-4c5c-a42f-208acdd8254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510e28e5-5ca3-4c5c-a42f-208acdd8254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '20fcb361-3833-43b2-823f-856ec34500b9', 'volume_name': 'volume-20fcb361-3833-43b2-823f-856ec34500b9', 'volume_size': 1, 'image_id': 'b7baefb4-1237-48ed-a08c-026992260a71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7baefb4-1237-48ed-a08c-026992260a71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5fe42ad4ff3b6c85562cc390ef236e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '42ca07512b4145f5b65272c778602cdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd49b45e10184c3093d76b1625ab50ec2dfad51ad66ad3a5c33d67631a7749ac9481ef30f14f51083a77413a280a1684e3b11d068f58f4736c602016937ad278a', 'id': 'b7baefb4-1237-48ed-a08c-026992260a71', 'created_at': datetime.datetime(2026, 6, 26, 20, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 21, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7baefb4-1237-48ed-a08c-026992260a71/file', 'properties': {}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f677cb7e-07fb-4699-9f64-9439ba11c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f677cb7e-07fb-4699-9f64-9439ba11c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bc30ae-4531-4895-9102-a47d942d7788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:21 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Volume 20fcb361-3833-43b2-823f-856ec34500b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-20fcb361-3833-43b2-823f-856ec34500b9', 'volume_size': 1, 'image_id': 'b7baefb4-1237-48ed-a08c-026992260a71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7baefb4-1237-48ed-a08c-026992260a71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5fe42ad4ff3b6c85562cc390ef236e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '42ca07512b4145f5b65272c778602cdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd49b45e10184c3093d76b1625ab50ec2dfad51ad66ad3a5c33d67631a7749ac9481ef30f14f51083a77413a280a1684e3b11d068f58f4736c602016937ad278a', 'id': 'b7baefb4-1237-48ed-a08c-026992260a71', 'created_at': datetime.datetime(2026, 6, 26, 20, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 21, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7baefb4-1237-48ed-a08c-026992260a71/file', 'properties': {}}, 'image_service': } Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Trying to clone 20fcb361-3833-43b2-823f-856ec34500b9 from image b7baefb4-1237-48ed-a08c-026992260a71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7baefb4-1237-48ed-a08c-026992260a71', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:21:21 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Image download 0.00 MB at 0.00 MB/s Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73695ce-d058-431a-8055-6064ab659d3f]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:21 devstack sudo[113738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD Jun 26 22:21:21 devstack sudo[113738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:22 devstack sudo[113738]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD" returned: 0 in 0.761s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:22 devstack sudo[113743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD Jun 26 22:21:22 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:23 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD" returned: 1 in 0.761s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:21:23 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Temporary image b7baefb4-1237-48ed-a08c-026992260a71 is fetched for user cc1480dd535b460cb152c636659591a8. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:21:23 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d27564-c54c-4ab8-a591-72ce8ae39fe7]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:23 devstack sudo[113748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD Jun 26 22:21:23 devstack sudo[113748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:24 devstack sudo[113748]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:24 devstack sudo[113752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD Jun 26 22:21:24 devstack sudo[113752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:24 devstack sudo[113752]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD" returned: 1 in 0.764s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20fcb361-3833-43b2-823f-856ec34500b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42ca07512b4145f5b65272c778602cdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:21:21Z,use_quota=True,user_id='cc1480dd535b460cb152c636659591a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Creating volume 20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:21:24 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:21:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:24 devstack sudo[113760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 1073741824 Jun 26 22:21:24 devstack sudo[113760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:25 devstack sudo[113760]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 1073741824" returned: 0 in 0.902s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:25 devstack sudo[113765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 Jun 26 22:21:25 devstack sudo[113765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:26 devstack sudo[113765]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9" returned: 0 in 0.688s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:21:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.644s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:26 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Attempting download of b7baefb4-1237-48ed-a08c-026992260a71 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7baefb4-1237-48ed-a08c-026992260a71', 'metadata': {}}])) to volume 20fcb361-3833-43b2-823f-856ec34500b9. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:21:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a858c5bb-9ee2-4526-aa8e-464ff45f8990]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7baefb4-1237-48ed-a08c-026992260a71_898araxi {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:26 devstack sudo[113769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7baefb4-1237-48ed-a08c-026992260a71_898araxi Jun 26 22:21:26 devstack sudo[113769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:27 devstack sudo[113769]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7baefb4-1237-48ed-a08c-026992260a71_898araxi" returned: 0 in 0.770s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7baefb4-1237-48ed-a08c-026992260a71_898araxi {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:27 devstack sudo[113773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7baefb4-1237-48ed-a08c-026992260a71_898araxi Jun 26 22:21:27 devstack sudo[113773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:28 devstack sudo[113773]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7baefb4-1237-48ed-a08c-026992260a71_898araxi" returned: 1 in 0.811s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7baefb4-1237-48ed-a08c-026992260a71_898araxi' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:21:28 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[66da8bab-323e-43df-8aad-a5f03d90692e]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:28 devstack sudo[113777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD Jun 26 22:21:28 devstack sudo[113777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:29 devstack sudo[113777]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:29 devstack sudo[113781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD Jun 26 22:21:29 devstack sudo[113781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Flow 'volume_create_manager' (13300a57-887a-42c6-b511-33a1c90db9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9046d7-9058-4b93-b846-f1a1662fd43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9046d7-9058-4b93-b846-f1a1662fd43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1808543780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5fd21b-c2f1-4791-9434-e8fae62f36fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20345a3b87b4cedb58d5c4bd93ebba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:21:29Z,use_quota=True,user_id='b12419435d054151b30eef9bffc3b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6d9165-5c9a-4531-844a-ea6ccfa972aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b6d9165-5c9a-4531-844a-ea6ccfa972aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f8a06b-1070-4e46-9bc5-04cbe1356aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90f8a06b-1070-4e46-9bc5-04cbe1356aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c5fd21b-c2f1-4791-9434-e8fae62f36fd', 'volume_name': 'volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74d61a3-c3f0-45b9-b248-16289572f1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c74d61a3-c3f0-45b9-b248-16289572f1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5189afe8-1247-4863-95b9-9c66b569cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:29 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Volume 3c5fd21b-c2f1-4791-9434-e8fae62f36fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd', 'volume_size': 1} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1808543780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c5fd21b-c2f1-4791-9434-e8fae62f36fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20345a3b87b4cedb58d5c4bd93ebba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:21:29Z,use_quota=True,user_id='b12419435d054151b30eef9bffc3b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Creating volume 3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:21:29 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:29 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd 1073741824 Jun 26 22:21:29 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:29 devstack sudo[113781]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD" returned: 1 in 0.722s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] b7baefb4-1237-48ed-a08c-026992260a71 was raw, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:21:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:29 devstack sudo[113788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 Jun 26 22:21:29 devstack sudo[113788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:30 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd 1073741824" returned: 0 in 0.877s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:30 devstack sudo[113793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd Jun 26 22:21:30 devstack sudo[113793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:30 devstack sudo[113788]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9" returned: 0 in 0.792s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7baefb4-1237-48ed-a08c-026992260a71_au2k8oqsdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:21:30 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Converted 0.00 MB image at 0.00 MB/s Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:30 devstack sudo[113798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 1G Jun 26 22:21:30 devstack sudo[113798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:30 devstack sudo[113793]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" returned: 0 in 0.664s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] <== create_volume: return (1588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5189afe8-1247-4863-95b9-9c66b569cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1da44-b110-4099-8cc0-10f84004245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:30 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Volume volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd (3c5fd21b-c2f1-4791-9434-e8fae62f36fd): created successfully Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd1da44-b110-4099-8cc0-10f84004245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:30 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Flow 'volume_create_manager' (13300a57-887a-42c6-b511-33a1c90db9a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:30 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b4dc76f4-9f42-456e-ac49-9bfd1e99048b tempest-SnapshotDependencyTests-1329237604 None] Created volume successfully. Jun 26 22:21:31 devstack sudo[113798]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 1G" returned: 0 in 0.714s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[70111ea6-ba3e-4139-9aed-f718cc2ee90e]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:31 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 Jun 26 22:21:31 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Creating offline snapshot fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 of volume 3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3800724c-468f-4ec2-ba89-b5ff28a23018]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:31 devstack sudo[113806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd Jun 26 22:21:31 devstack sudo[113806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:32 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9" returned: 0 in 0.779s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:32 devstack sudo[113810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 Jun 26 22:21:32 devstack sudo[113810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:32 devstack sudo[113806]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" returned: 0 in 0.799s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:32 devstack sudo[113815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 1G Jun 26 22:21:32 devstack sudo[113815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:32 devstack sudo[113810]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9" returned: 1 in 0.757s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Downloaded image b7baefb4-1237-48ed-a08c-026992260a71 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7baefb4-1237-48ed-a08c-026992260a71', 'metadata': {}}])) to volume 20fcb361-3833-43b2-823f-856ec34500b9 successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Temporary image b7baefb4-1237-48ed-a08c-026992260a71 for user cc1480dd535b460cb152c636659591a8 is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Marking volume 20fcb361-3833-43b2-823f-856ec34500b9 as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Copying metadata from image b7baefb4-1237-48ed-a08c-026992260a71 to 20fcb361-3833-43b2-823f-856ec34500b9. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Creating volume glance metadata for volume 20fcb361-3833-43b2-823f-856ec34500b9 backed by image b7baefb4-1237-48ed-a08c-026992260a71 with: {'image_id': 'b7baefb4-1237-48ed-a08c-026992260a71', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c5fe42ad4ff3b6c85562cc390ef236e1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76bc30ae-4531-4895-9102-a47d942d7788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20fcb361-3833-43b2-823f-856ec34500b9', 'volume_size': 1, 'image_id': 'b7baefb4-1237-48ed-a08c-026992260a71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7baefb4-1237-48ed-a08c-026992260a71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c5fe42ad4ff3b6c85562cc390ef236e1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '42ca07512b4145f5b65272c778602cdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd49b45e10184c3093d76b1625ab50ec2dfad51ad66ad3a5c33d67631a7749ac9481ef30f14f51083a77413a280a1684e3b11d068f58f4736c602016937ad278a', 'id': 'b7baefb4-1237-48ed-a08c-026992260a71', 'created_at': datetime.datetime(2026, 6, 26, 20, 21, 18, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 21, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7baefb4-1237-48ed-a08c-026992260a71/file', 'properties': {}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725d897c-6808-4fb7-9757-87aef77e951a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Volume volume-20fcb361-3833-43b2-823f-856ec34500b9 (20fcb361-3833-43b2-823f-856ec34500b9): created successfully Jun 26 22:21:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725d897c-6808-4fb7-9757-87aef77e951a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Flow 'volume_create_manager' (cd13bb8c-c709-45c7-a6f6-8fef538f84db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-befae4f0-c88f-4118-b45f-5e77c6805bdb tempest-VolumeImageDependencyTests-608524055 None] Created volume successfully. Jun 26 22:21:33 devstack sudo[113815]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 1G" returned: 0 in 0.836s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:33 devstack sudo[113823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 Jun 26 22:21:33 devstack sudo[113823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Acquiring lock "cinder-20fcb361-3833-43b2-823f-856ec34500b9-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Lock "cinder-20fcb361-3833-43b2-823f-856ec34500b9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Acquiring lock "cinder-quobyte-20fcb361-3833-43b2-823f-856ec34500b9" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Lock "cinder-quobyte-20fcb361-3833-43b2-823f-856ec34500b9" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bc6f1d-ea00-46a3-a7e6-4091e1d65989]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:34 devstack sudo[113823]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" returned: 0 in 0.797s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:34 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 is being set with open permissions: ugo+rw Jun 26 22:21:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:34 devstack sudo[113830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 Jun 26 22:21:34 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:34 devstack sudo[113829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 Jun 26 22:21:34 devstack sudo[113829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:34 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" returned: 0 in 0.647s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:34 devstack sudo[113829]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9" returned: 0 in 0.782s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:34 devstack sudo[113836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.info Jun 26 22:21:34 devstack sudo[113836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:34 devstack sudo[113837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 Jun 26 22:21:34 devstack sudo[113837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:35 devstack sudo[113836]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.info" returned: 0 in 0.639s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:35 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.info is being set with open permissions: ugo+rw Jun 26 22:21:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:35 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.info Jun 26 22:21:35 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:35 devstack sudo[113837]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9" returned: 1 in 0.766s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:21:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:35 devstack sudo[113847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9 Jun 26 22:21:35 devstack sudo[113847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:35 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.info" returned: 0 in 0.652s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.476s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:36 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-57960097-e2a2-4dda-b12c-c704299bb7b1 tempest-SnapshotDependencyTests-1329237604 None] Create snapshot completed successfully Jun 26 22:21:36 devstack sudo[113847]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-20fcb361-3833-43b2-823f-856ec34500b9" returned: 0 in 0.697s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Lock "cinder-quobyte-20fcb361-3833-43b2-823f-856ec34500b9" released by "delete_volume" :: held 2.333s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Created reservations ['7801f794-47a5-4245-9ebe-ec3697e4e740', '610f1deb-9bd1-4175-afd7-e7586175b743', 'c2212bd6-7e32-499f-bb09-dde671a628e2', '008ed30e-9be5-47cd-b07f-74713361f3d8'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:36 devstack sudo[113851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:36 devstack sudo[113851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:36 devstack sudo[113851]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.667s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:36 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:36 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Deleted volume successfully. Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e5fe116f-0172-45e0-b299-ff63420dabd3 tempest-VolumeImageDependencyTests-608524055 None] Lock "cinder-20fcb361-3833-43b2-823f-856ec34500b9-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Flow 'volume_create_manager' (7f2c42b4-3dea-4ca8-a380-87f26632daad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0deb705-6e4a-4300-90d5-f035bf0e7f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0deb705-6e4a-4300-90d5-f035bf0e7f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:21:37Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9952c7f6-1ef9-42c7-a476-d2dfe30be41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a20345a3b87b4cedb58d5c4bd93ebba0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:21:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:21:37Z,use_quota=True,user_id='b12419435d054151b30eef9bffc3b99c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7453278e-caee-4788-8ffe-6a66a6a877c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7453278e-caee-4788-8ffe-6a66a6a877c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef6424-f318-4405-aa6f-a6256aae4eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef6424-f318-4405-aa6f-a6256aae4eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9952c7f6-1ef9-42c7-a476-d2dfe30be41f', 'volume_name': 'volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f', 'volume_size': 1, 'snapshot_id': 'fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1f24d4-142f-4751-b8ca-4c68bdffbd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1f24d4-142f-4751-b8ca-4c68bdffbd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f741bcb-f8e0-4fcc-bdf1-6f2eaad351bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:37 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Volume 9952c7f6-1ef9-42c7-a476-d2dfe30be41f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f', 'volume_size': 1, 'snapshot_id': 'fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6'} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-quobyte-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Creating volume 9952c7f6-1ef9-42c7-a476-d2dfe30be41f from snapshot fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-quobyte-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] snapshot: fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6, volume: 9952c7f6-1ef9-42c7-a476-d2dfe30be41f, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[640251c3-191d-4ff4-b903-6903daa7af3e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:37 devstack sudo[113854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 Jun 26 22:21:37 devstack sudo[113854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:38 devstack sudo[113854]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" returned: 0 in 0.797s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:21:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:21:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:21:38 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9febc7-de26-48ac-a6db-42095af862f0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:38 devstack sudo[113859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd Jun 26 22:21:38 devstack sudo[113859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:39 devstack sudo[113859]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" returned: 0 in 0.789s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:39 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:21:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:39 devstack sudo[113864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f Jun 26 22:21:39 devstack sudo[113864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:43 devstack sudo[113864]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" returned: 0 in 4.527s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:43 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[247c201f-82f4-4a5a-b538-b072e3ca1221]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:43 devstack sudo[113877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd Jun 26 22:21:43 devstack sudo[113877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:44 devstack sudo[113877]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" returned: 0 in 0.904s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:44 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd, size 1024.00 MB, duration 4.53 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:21:44 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Converted 1024.00 MB image at 226.07 MB/s Jun 26 22:21:44 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f is being set with open permissions: ugo+rw Jun 26 22:21:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:44 devstack sudo[113888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f Jun 26 22:21:44 devstack sudo[113888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:45 devstack sudo[113888]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" returned: 0 in 0.648s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" released by "_copy_volume_from_snapshot" :: held 7.786s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" released by "_create_volume_from_snapshot" :: held 7.814s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.833s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f741bcb-f8e0-4fcc-bdf1-6f2eaad351bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f', 'volume_size': 1, 'snapshot_id': 'fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774c2258-c895-4627-88f4-f67e59608060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:21:45 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Volume volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f (9952c7f6-1ef9-42c7-a476-d2dfe30be41f): created successfully Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (774c2258-c895-4627-88f4-f67e59608060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:21:45 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Flow 'volume_create_manager' (7f2c42b4-3dea-4ca8-a380-87f26632daad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:21:45 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-8e45ed2e-286d-47fb-8c9b-03d6395822ee tempest-SnapshotDependencyTests-1329237604 None] Created volume successfully. Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-quobyte-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-quobyte-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Deleting offline snapshot fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 of volume 3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] snapshot_file for this snap is: volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[886897d0-59e3-48a9-a204-52c1b3a1b5fb]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:46 devstack sudo[113892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 Jun 26 22:21:46 devstack sudo[113892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:46 devstack sudo[113894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:46 devstack sudo[113894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:46 devstack sudo[113892]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" returned: 0 in 0.762s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de8ec3-c8e4-407a-a93d-22e590ebdfa0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:46 devstack sudo[113899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd Jun 26 22:21:46 devstack sudo[113899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:47 devstack sudo[113894]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.656s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:21:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:21:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:21:47 devstack sudo[113899]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" returned: 0 in 0.753s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:47 devstack sudo[113905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 Jun 26 22:21:47 devstack sudo[113905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:48 devstack sudo[113905]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" returned: 0 in 0.719s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:48 devstack sudo[113910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6 Jun 26 22:21:48 devstack sudo[113910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:48 devstack sudo[113910]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd.fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" returned: 0 in 0.643s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=67,cinder:UPDATE=108,cinder:INSERT=27,cinder:DELETE=6 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=74,cinder:UPDATE=84,cinder:DELETE=12,cinder:INSERT=26 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6" released by "_delete_snapshot" :: held 2.981s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" released by "delete_snapshot" :: held 3.007s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Created reservations ['ccbc566d-dda3-484c-86c1-18dfc0e8d1ae', '80be257b-9843-4d84-8803-4107ed992464', 'a3dc8900-3079-4d07-95d5-86a437b0cb2b', '45da7fdd-c88e-4d10-b4c0-fc54cd82223a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:49 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Delete snapshot completed successfully. Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-b2a435d2-293a-42dc-bd89-3f6a5e1db043 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-fcd0e9c4-8557-4e5a-aa7a-36e9de7e71e6-delete_snapshot" released by "delete_snapshot" :: held 3.142s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-3c5fd21b-c2f1-4791-9434-e8fae62f36fd-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-3c5fd21b-c2f1-4791-9434-e8fae62f36fd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-quobyte-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bfecc09-df46-4c82-8b0c-daa885917826]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:49 devstack sudo[113913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd Jun 26 22:21:49 devstack sudo[113913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:50 devstack sudo[113913]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" returned: 0 in 0.759s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:50 devstack sudo[113918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd Jun 26 22:21:50 devstack sudo[113918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:50 devstack sudo[113918]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" returned: 0 in 0.648s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-3c5fd21b-c2f1-4791-9434-e8fae62f36fd" released by "delete_volume" :: held 1.465s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Created reservations ['46d732e7-1280-4645-b67a-bfb7f9e95d5d', 'b8e089a8-dc1b-424e-835c-fcb72576e8ea', '9d9a2782-92ba-4202-980d-bd70065b14a8', '63ef65c7-2588-4983-b486-4f507efc57e3'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:50 devstack sudo[113921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:50 devstack sudo[113921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-9952c7f6-1ef9-42c7-a476-d2dfe30be41f-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-9952c7f6-1ef9-42c7-a476-d2dfe30be41f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "cinder-quobyte-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:21:51 devstack sudo[113921]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.710s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b925ef-100c-4bb7-8b2a-1c1e1c13e5cb]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Deleted volume successfully. Jun 26 22:21:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-05863b51-0df6-4eaa-8178-4864e5a9bdd6 tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-3c5fd21b-c2f1-4791-9434-e8fae62f36fd-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:51 devstack sudo[113924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f Jun 26 22:21:51 devstack sudo[113924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:52 devstack sudo[113924]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" returned: 0 in 0.772s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:52 devstack sudo[113929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f Jun 26 22:21:52 devstack sudo[113929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:52 devstack sudo[113929]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" returned: 0 in 0.655s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-quobyte-9952c7f6-1ef9-42c7-a476-d2dfe30be41f" released by "delete_volume" :: held 1.470s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Created reservations ['54dacc80-b41b-4d7b-9d85-a874f2188ab2', '0d534682-8104-4586-aeb0-85f18681d752', '6de925b9-56a7-4741-bde5-8167bd83d9fd', '9284b664-d1f3-4acc-8714-c7ce41d822b2'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:21:53 devstack sudo[113932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:21:53 devstack sudo[113932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:21:53 devstack sudo[113932]: pam_unix(sudo:session): session closed for user root Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.696s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:21:53 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Deleted volume successfully. Jun 26 22:21:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a87566d8-8ef6-4672-a5de-e56a2ab4eaaa tempest-SnapshotDependencyTests-1329237604 None] Lock "cinder-9952c7f6-1ef9-42c7-a476-d2dfe30be41f-delete_volume" released by "delete_volume" :: held 2.373s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:03 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:22:03 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (09e2fd10-3464-4604-aa19-acea83423898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dabb9e-7f65-4f5f-8f5d-5b50d3d6c8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74dabb9e-7f65-4f5f-8f5d-5b50d3d6c8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034263542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82618774-a255-4d5c-bec8-1b9b503e2435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:13Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11df77b7-3c6f-4395-b603-7d8e3319ba8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11df77b7-3c6f-4395-b603-7d8e3319ba8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc02b9f-ea1a-4b26-bcf8-99fb3ca37922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc02b9f-ea1a-4b26-bcf8-99fb3ca37922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82618774-a255-4d5c-bec8-1b9b503e2435', 'volume_name': 'volume-82618774-a255-4d5c-bec8-1b9b503e2435', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d271c800-ad70-4ba0-822e-793a1589521e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d271c800-ad70-4ba0-822e-793a1589521e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fdcd5-5317-437d-9fb2-3aa78c4be6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume 82618774-a255-4d5c-bec8-1b9b503e2435: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82618774-a255-4d5c-bec8-1b9b503e2435', 'volume_size': 1} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2034263542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82618774-a255-4d5c-bec8-1b9b503e2435,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:13Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Creating volume 82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:13 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:13 devstack sudo[114015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 1073741824 Jun 26 22:22:13 devstack sudo[114015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (a5d17970-8914-47c3-b359-5cbb4eb6bda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18317cd2-b93a-452a-8a52-0ec66821b837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18317cd2-b93a-452a-8a52-0ec66821b837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1340775780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935f5b53-07a4-4591-928a-95466878ff84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:13Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7a81b9-65ce-4086-941f-43d5647e71b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae7a81b9-65ce-4086-941f-43d5647e71b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381329f7-eae7-4edb-88aa-bb56fa440ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381329f7-eae7-4edb-88aa-bb56fa440ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '935f5b53-07a4-4591-928a-95466878ff84', 'volume_name': 'volume-935f5b53-07a4-4591-928a-95466878ff84', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e47fd23-4a69-4c61-abbf-b796e1d5a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e47fd23-4a69-4c61-abbf-b796e1d5a570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b7912c-c741-43b9-8af0-bfc1ddb188be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Volume 935f5b53-07a4-4591-928a-95466878ff84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-935f5b53-07a4-4591-928a-95466878ff84', 'volume_size': 1} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (e7dcab83-1849-4648-8320-f7295de629e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b23902-2fcb-4c4e-ae70-1d10323a4538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b23902-2fcb-4c4e-ae70-1d10323a4538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-301883664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4957c1f-6a59-4d51-a60d-9a27f1dd20c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:14Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0223c58c-457f-4f7f-8ff5-458499df5b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0223c58c-457f-4f7f-8ff5-458499df5b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273bb7da-ade2-411b-b154-267a6ffee839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (273bb7da-ade2-411b-b154-267a6ffee839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4957c1f-6a59-4d51-a60d-9a27f1dd20c7', 'volume_name': 'volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48887e98-4f05-4f9d-8fd1-f86965283925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48887e98-4f05-4f9d-8fd1-f86965283925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0da0989-b10f-41f5-8666-ba55dd99568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Volume d4957c1f-6a59-4d51-a60d-9a27f1dd20c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7', 'volume_size': 1} Jun 26 22:22:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (00547fa6-a6e1-4edd-8b5f-0a72bf68d25b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e75352-6535-4875-b104-a91214754c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:14 devstack sudo[114015]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9e75352-6535-4875-b104-a91214754c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450477997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb950a1b-89cd-43f6-aedd-2aee6b451d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:14Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d46d44-2673-4937-8f24-1d326bd58457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1d46d44-2673-4937-8f24-1d326bd58457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32c0b19-233f-4f9d-b73d-33f91ae937c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32c0b19-233f-4f9d-b73d-33f91ae937c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb950a1b-89cd-43f6-aedd-2aee6b451d85', 'volume_name': 'volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2d4a82-0050-4c48-ae80-56f2bacb7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2d4a82-0050-4c48-ae80-56f2bacb7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f83c608-1b5d-4358-b95d-b5e287d858ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:14 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume cb950a1b-89cd-43f6-aedd-2aee6b451d85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85', 'volume_size': 1} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 1073741824" returned: 0 in 1.323s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:14 devstack sudo[114022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 Jun 26 22:22:14 devstack sudo[114022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (bd70f97a-98a2-409f-be9a-add43ac49894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:14 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba2f8fb-5423-4ef4-aa92-ffc159e1b0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (c7038735-764c-4b50-9ebb-353114d99bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8c90f4-7cfd-4d64-8e84-211be91f8ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ba2f8fb-5423-4ef4-aa92-ffc159e1b0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246050313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab8d5fd-4875-4d54-9f8d-b084e559a3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:15Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7fdb94-c311-491e-bbc4-1a4f55adb3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7fdb94-c311-491e-bbc4-1a4f55adb3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c01e44-fd16-46fb-9bd2-07735b26b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c01e44-fd16-46fb-9bd2-07735b26b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ab8d5fd-4875-4d54-9f8d-b084e559a3e0', 'volume_name': 'volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a954e4-611c-454b-aa30-07822bee5cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03a954e4-611c-454b-aa30-07822bee5cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b53f26-bfd2-4fec-b789-38f4f95d9991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Volume 8ab8d5fd-4875-4d54-9f8d-b084e559a3e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0', 'volume_size': 1} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e8c90f4-7cfd-4d64-8e84-211be91f8ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346971382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea790ea4-3b73-44de-a4b4-7b34eda98ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:15Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c534f4-7bf9-4285-a07a-8199d43410b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c534f4-7bf9-4285-a07a-8199d43410b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f133ef-849a-48a7-a57c-e996b35b2c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f133ef-849a-48a7-a57c-e996b35b2c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea790ea4-3b73-44de-a4b4-7b34eda98ee2', 'volume_name': 'volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a6cc31-3ac7-45ed-bf1b-36ceea9ace9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1a6cc31-3ac7-45ed-bf1b-36ceea9ace9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635e4a43-0b2f-420a-ae34-155421c1f680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Volume ea790ea4-3b73-44de-a4b4-7b34eda98ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2', 'volume_size': 1} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (9b6c47d5-711f-44d4-a034-888627bd6fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3a21e9-8cd3-4e68-b6dc-5e5414b149a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3a21e9-8cd3-4e68-b6dc-5e5414b149a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372186454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f07b3e-a543-414d-af04-bbd213d2acb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:15Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1cc840-4a45-4a2b-a424-a86275d2cbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b1cc840-4a45-4a2b-a424-a86275d2cbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7df2485-d39e-4788-9c11-18cd1a0f08ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7df2485-d39e-4788-9c11-18cd1a0f08ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f07b3e-a543-414d-af04-bbd213d2acb8', 'volume_name': 'volume-04f07b3e-a543-414d-af04-bbd213d2acb8', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53637725-f8a2-4fa5-9ff7-9caab9cf2c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53637725-f8a2-4fa5-9ff7-9caab9cf2c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7895dd72-6d56-4b5d-9fff-37a084aaf697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Volume 04f07b3e-a543-414d-af04-bbd213d2acb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f07b3e-a543-414d-af04-bbd213d2acb8', 'volume_size': 1} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:15 devstack sudo[114022]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435" returned: 0 in 0.842s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] <== create_volume: return (2218ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.221s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.847s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1340775780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=935f5b53-07a4-4591-928a-95466878ff84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:13Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Creating volume 935f5b53-07a4-4591-928a-95466878ff84 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:15 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:15 devstack sudo[114026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 1073741824 Jun 26 22:22:15 devstack sudo[114026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fdcd5-5317-437d-9fb2-3aa78c4be6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82618774-a255-4d5c-bec8-1b9b503e2435', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052e34f0-297e-4ff3-be9b-80990c141404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:15 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume volume-82618774-a255-4d5c-bec8-1b9b503e2435 (82618774-a255-4d5c-bec8-1b9b503e2435): created successfully Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (052e34f0-297e-4ff3-be9b-80990c141404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:15 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (09e2fd10-3464-4604-aa19-acea83423898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:15 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d18eda85-f249-4d42-8267-a6f6256b29f4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created volume successfully. Jun 26 22:22:16 devstack sudo[114026]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 1073741824" returned: 0 in 0.965s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:16 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 Jun 26 22:22:16 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:17 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Flow 'volume_create_manager' (1a0a486e-328f-46d3-98fb-7bbc4c206481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff48613-104e-47ea-8aa4-d605cb177771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84" returned: 0 in 0.736s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.345s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-301883664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4957c1f-6a59-4d51-a60d-9a27f1dd20c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:14Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Creating volume d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:17 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff48613-104e-47ea-8aa4-d605cb177771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88ad1a7-65d3-42ff-b481-4c9d242c5899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3049e2a0d62345ca9efc543040b474ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:17Z,use_quota=True,user_id='e1687bd78af24bc5b29133aef8815e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10dd7aa3-632f-416b-bf9a-925df2c3522e),volume_type_id=10dd7aa3-632f-416b-bf9a-925df2c3522e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:17 devstack sudo[114035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 1073741824 Jun 26 22:22:17 devstack sudo[114035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058e4711-2084-4687-ae97-f3b329c98178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (058e4711-2084-4687-ae97-f3b329c98178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fadbe4-a81b-4e3d-b55e-af91ebbc794c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b7912c-c741-43b9-8af0-bfc1ddb188be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-935f5b53-07a4-4591-928a-95466878ff84', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd94e00-dbeb-4892-a98a-f1bf28479718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:17 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Volume volume-935f5b53-07a4-4591-928a-95466878ff84 (935f5b53-07a4-4591-928a-95466878ff84): created successfully Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd94e00-dbeb-4892-a98a-f1bf28479718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (a5d17970-8914-47c3-b359-5cbb4eb6bda4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:17 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bbe91b3b-097a-42c7-968e-0cbc87fbafa7 tempest-CreateVolumesFromImageTest-2063162272 None] Created volume successfully. Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13fadbe4-a81b-4e3d-b55e-af91ebbc794c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f88ad1a7-65d3-42ff-b481-4c9d242c5899', 'volume_name': 'volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899', 'volume_size': 1, 'image_id': '89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d485d18717ad89f6ebbd25b7269937c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3049e2a0d62345ca9efc543040b474ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a49bfba583467e5afca104867e07b2e5b0597082afb1d912ae5c0e6230c5a6a61213ea2c9c8a4ccd206cc94d8cd9b81102cbf40b045b084b3ee1fb7b0579f42b', 'id': '89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'created_at': datetime.datetime(2026, 6, 26, 20, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 22, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6676422-6eb6-414e-8ad1-3809bba289f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6676422-6eb6-414e-8ad1-3809bba289f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689075af-a989-41b5-96ed-cb126567c236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:17 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Volume f88ad1a7-65d3-42ff-b481-4c9d242c5899: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899', 'volume_size': 1, 'image_id': '89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d485d18717ad89f6ebbd25b7269937c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3049e2a0d62345ca9efc543040b474ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a49bfba583467e5afca104867e07b2e5b0597082afb1d912ae5c0e6230c5a6a61213ea2c9c8a4ccd206cc94d8cd9b81102cbf40b045b084b3ee1fb7b0579f42b', 'id': '89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'created_at': datetime.datetime(2026, 6, 26, 20, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 22, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Trying to clone f88ad1a7-65d3-42ff-b481-4c9d242c5899 from image 89592d0b-e3c5-4f60-8e7c-a62e2b068345 at location (None, [{'url': 'file:///opt/stack/data/glance/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:22:17 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Image download 0.00 MB at 0.00 MB/s Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab372cda-17ec-44a1-a9b1-c8e1f83783d5]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:17 devstack sudo[114037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD Jun 26 22:22:17 devstack sudo[114037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:18 devstack sudo[114035]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 1073741824" returned: 0 in 0.825s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:18 devstack sudo[114043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 Jun 26 22:22:18 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:18 devstack sudo[114037]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD" returned: 0 in 0.757s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:18 devstack sudo[114047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD Jun 26 22:22:18 devstack sudo[114047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:18 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7" returned: 0 in 0.674s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.558s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.206s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-450477997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb950a1b-89cd-43f6-aedd-2aee6b451d85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:14Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Creating volume cb950a1b-89cd-43f6-aedd-2aee6b451d85 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:18 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:18 devstack sudo[114050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 1073741824 Jun 26 22:22:18 devstack sudo[114050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0da0989-b10f-41f5-8666-ba55dd99568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b893a5-c22e-43b1-9428-77f6c79ef4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:18 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Volume volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 (d4957c1f-6a59-4d51-a60d-9a27f1dd20c7): created successfully Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86b893a5-c22e-43b1-9428-77f6c79ef4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:18 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (e7dcab83-1849-4648-8320-f7295de629e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-21474baa-cc84-4e44-95f0-80fd424d13f2 tempest-CreateVolumesFromImageTest-2063162272 None] Created volume successfully. Jun 26 22:22:19 devstack sudo[114047]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD" returned: 1 in 0.812s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:19 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Temporary image 89592d0b-e3c5-4f60-8e7c-a62e2b068345 is fetched for user e1687bd78af24bc5b29133aef8815e71. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:22:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81788cd-ac1c-418e-b8b6-528e8155c141]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:19 devstack sudo[114058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD Jun 26 22:22:19 devstack sudo[114058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:19 devstack sudo[114050]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 1073741824" returned: 0 in 0.847s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:19 devstack sudo[114060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 Jun 26 22:22:19 devstack sudo[114060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:20 devstack sudo[114058]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:20 devstack sudo[114064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD Jun 26 22:22:20 devstack sudo[114064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:20 devstack sudo[114060]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85" returned: 0 in 0.645s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.292s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-246050313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ab8d5fd-4875-4d54-9f8d-b084e559a3e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:15Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Creating volume 8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:20 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f83c608-1b5d-4358-b95d-b5e287d858ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561cb426-9799-4279-b8e7-e91f05c7b95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:20 devstack sudo[114067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 1073741824 Jun 26 22:22:20 devstack sudo[114067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:20 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 (cb950a1b-89cd-43f6-aedd-2aee6b451d85): created successfully Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561cb426-9799-4279-b8e7-e91f05c7b95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (00547fa6-a6e1-4edd-8b5f-0a72bf68d25b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:20 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7dc68e9f-ad44-4830-8b47-af575d3178b0 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created volume successfully. Jun 26 22:22:20 devstack sudo[114064]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD" returned: 1 in 0.747s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:21 devstack sudo[114067]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 1073741824" returned: 0 in 0.858s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:21 devstack sudo[114075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 Jun 26 22:22:21 devstack sudo[114075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:21 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (5a2dc814-0b34-4f34-9cb7-be65ba797e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9304f32a-f390-4bca-9183-f32d4ada5727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9304f32a-f390-4bca-9183-f32d4ada5727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172261769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400fa87b-b4a4-4cab-90a8-6179a706ad40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:22Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc59454-9e75-46fa-917b-55c232a87339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbc59454-9e75-46fa-917b-55c232a87339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d51d709-76cc-43b3-9767-ae55533b6d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack sudo[114075]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d51d709-76cc-43b3-9767-ae55533b6d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '400fa87b-b4a4-4cab-90a8-6179a706ad40', 'volume_name': 'volume-400fa87b-b4a4-4cab-90a8-6179a706ad40', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26afef7-c757-4d92-b1b2-d9a51c92bfe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a26afef7-c757-4d92-b1b2-d9a51c92bfe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ccee6-3c73-4946-be4d-acdec9a87f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume 400fa87b-b4a4-4cab-90a8-6179a706ad40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-400fa87b-b4a4-4cab-90a8-6179a706ad40', 'volume_size': 1} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0" returned: 0 in 0.772s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.670s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.916s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346971382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea790ea4-3b73-44de-a4b4-7b34eda98ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:15Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Creating volume ea790ea4-3b73-44de-a4b4-7b34eda98ee2 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:22 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:22 devstack sudo[114078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 1073741824 Jun 26 22:22:22 devstack sudo[114078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96b53f26-bfd2-4fec-b789-38f4f95d9991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7f80eb-a2aa-4c7c-adfb-d48142b0ecff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Volume volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 (8ab8d5fd-4875-4d54-9f8d-b084e559a3e0): created successfully Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df7f80eb-a2aa-4c7c-adfb-d48142b0ecff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (bd70f97a-98a2-409f-be9a-add43ac49894) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:22 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1fc2512b-4e52-46ed-87f3-69a671f90016 tempest-CreateVolumesFromImageTest-2063162272 None] Created volume successfully. Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (c4f72c88-b59d-44f1-a6ce-d87967303f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c2af24-0b8a-471f-ac3d-884a3c8cef6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c2af24-0b8a-471f-ac3d-884a3c8cef6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609852904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:22Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b8b465-0a71-4d2d-8321-1f8f51144a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b8b465-0a71-4d2d-8321-1f8f51144a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a503288-28b8-4116-a1a8-1022c93c2a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a503288-28b8-4116-a1a8-1022c93c2a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd', 'volume_name': 'volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e0187a-d4c4-47e6-824f-dc41e9441adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73e0187a-d4c4-47e6-824f-dc41e9441adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3def368-6b9b-41a8-abed-8a0c822f7a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume 2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd', 'volume_size': 1} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (9f56075c-6a85-4980-ae09-6ca58d1a4102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4eb940-de47-48bf-ba1c-14bead667926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4eb940-de47-48bf-ba1c-14bead667926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1650043537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af506e69-53a4-43cc-a38b-56855f521e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:23Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea68fec9-e1d6-4750-9f10-bf3c97bf79c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea68fec9-e1d6-4750-9f10-bf3c97bf79c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b3f799-8881-41ec-a8f8-3aac76271b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8b3f799-8881-41ec-a8f8-3aac76271b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af506e69-53a4-43cc-a38b-56855f521e3b', 'volume_name': 'volume-af506e69-53a4-43cc-a38b-56855f521e3b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0525f22b-147b-43f4-9f87-bd11d2e1942b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0525f22b-147b-43f4-9f87-bd11d2e1942b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1f2132-ccc2-4d33-894d-5268e269b8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:22 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume af506e69-53a4-43cc-a38b-56855f521e3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af506e69-53a4-43cc-a38b-56855f521e3b', 'volume_size': 1} Jun 26 22:22:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:23 devstack sudo[114078]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 1073741824" returned: 0 in 1.005s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:23 devstack sudo[114085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 Jun 26 22:22:23 devstack sudo[114085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (b6b8126b-14aa-4440-bf74-bc3de91d9471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9744977-7276-4eff-8046-952a7809a3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9744977-7276-4eff-8046-952a7809a3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629686009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2190f691-2f0f-4e89-868f-16cb26159405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:23Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74fa5cf-1fdc-4290-bbe7-106788a357c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74fa5cf-1fdc-4290-bbe7-106788a357c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74ace37-0378-4a3d-bb58-4bca2c063896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d74ace37-0378-4a3d-bb58-4bca2c063896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2190f691-2f0f-4e89-868f-16cb26159405', 'volume_name': 'volume-2190f691-2f0f-4e89-868f-16cb26159405', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d6a77b-4238-46f9-b042-68d6a4324639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d6a77b-4238-46f9-b042-68d6a4324639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3693678-47ec-449d-8506-b18898db16c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume 2190f691-2f0f-4e89-868f-16cb26159405: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2190f691-2f0f-4e89-868f-16cb26159405', 'volume_size': 1} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (96b20414-a6d1-4043-aaf6-fbdf88e6cda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecceabe-65f0-4681-a145-a48203f4ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ecceabe-65f0-4681-a145-a48203f4ce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-268794946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b44c53-244d-4534-ac19-0bbf415cb497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:23Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429755c6-e97d-400a-ba35-905095b08406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (429755c6-e97d-400a-ba35-905095b08406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692bc64b-355b-421c-bb36-98c099a4ebf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (692bc64b-355b-421c-bb36-98c099a4ebf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31b44c53-244d-4534-ac19-0bbf415cb497', 'volume_name': 'volume-31b44c53-244d-4534-ac19-0bbf415cb497', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a821f212-e132-4619-acfe-d04c97df300a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a821f212-e132-4619-acfe-d04c97df300a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b3b672-0fac-40e1-8d12-baf3c145c2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume 31b44c53-244d-4534-ac19-0bbf415cb497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31b44c53-244d-4534-ac19-0bbf415cb497', 'volume_size': 1} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:23 devstack sudo[114085]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2" returned: 0 in 0.707s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] <== create_volume: return (1758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.761s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.569s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-372186454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f07b3e-a543-414d-af04-bbd213d2acb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa660c3da22f4b9cbe61456345b5c523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:15Z,use_quota=True,user_id='73667bd449f54da4bbcaa1a7597f1f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Creating volume 04f07b3e-a543-414d-af04-bbd213d2acb8 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:23 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:23 devstack sudo[114088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 1073741824 Jun 26 22:22:23 devstack sudo[114088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635e4a43-0b2f-420a-ae34-155421c1f680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391495aa-e1a0-44fd-af57-06cfa4a9a872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Volume volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 (ea790ea4-3b73-44de-a4b4-7b34eda98ee2): created successfully Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391495aa-e1a0-44fd-af57-06cfa4a9a872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (c7038735-764c-4b50-9ebb-353114d99bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:23 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-025a10a2-ca24-4233-9018-ff79e1f36e5f tempest-CreateVolumesFromImageTest-2063162272 None] Created volume successfully. Jun 26 22:22:24 devstack sudo[114088]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 1073741824" returned: 0 in 0.832s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:24 devstack sudo[114094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 Jun 26 22:22:24 devstack sudo[114094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:25 devstack sudo[114094]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8" returned: 0 in 0.647s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.520s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.859s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7895dd72-6d56-4b5d-9fff-37a084aaf697) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f07b3e-a543-414d-af04-bbd213d2acb8', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc85a9d9-2ed6-4228-a06a-7b832718c370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Creating offline snapshot 7c6628d6-80c4-4ef1-be42-157c1fb453b1 of volume 82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:22:25 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Volume volume-04f07b3e-a543-414d-af04-bbd213d2acb8 (04f07b3e-a543-414d-af04-bbd213d2acb8): created successfully Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc85a9d9-2ed6-4228-a06a-7b832718c370) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Flow 'volume_create_manager' (9b6c47d5-711f-44d4-a034-888627bd6fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[228f5374-18bc-4d90-a2ec-e5325b841912]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d9d5a49a-4218-4b43-b4d2-0522c46630e8 tempest-CreateVolumesFromImageTest-2063162272 None] Created volume successfully. Jun 26 22:22:25 devstack sudo[114100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 Jun 26 22:22:25 devstack sudo[114100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-04f07b3e-a543-414d-af04-bbd213d2acb8-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-04f07b3e-a543-414d-af04-bbd213d2acb8-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-quobyte-04f07b3e-a543-414d-af04-bbd213d2acb8" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-04f07b3e-a543-414d-af04-bbd213d2acb8" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:26 devstack sudo[114100]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435" returned: 0 in 0.781s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b91fd38-f2f2-4358-b0f3-4c8c56a1dd67]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:26 devstack sudo[114105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 1G Jun 26 22:22:26 devstack sudo[114105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:26 devstack sudo[114106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 Jun 26 22:22:26 devstack sudo[114106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:26 devstack sudo[114106]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8" returned: 0 in 0.780s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:27 devstack sudo[114117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8 Jun 26 22:22:27 devstack sudo[114117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:27 devstack sudo[114105]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 1G" returned: 0 in 0.866s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82618774-a255-4d5c-bec8-1b9b503e2435 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:27 devstack sudo[114119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82618774-a255-4d5c-bec8-1b9b503e2435 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 Jun 26 22:22:27 devstack sudo[114119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:27 devstack sudo[114117]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-04f07b3e-a543-414d-af04-bbd213d2acb8" returned: 0 in 0.679s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-04f07b3e-a543-414d-af04-bbd213d2acb8" released by "delete_volume" :: held 1.508s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Created reservations ['7dd15597-7732-4279-b7b7-c96172059e34', '899bb01c-f7ce-4958-8419-9a8f369a0431', '014fd674-0d75-459e-8bd4-5bf38cd20245', 'ed799d0b-0b79-4fb6-a8d7-80818d81b1ff'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:27 devstack sudo[114126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:27 devstack sudo[114126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:27 devstack sudo[114119]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-82618774-a255-4d5c-bec8-1b9b503e2435 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1" returned: 0 in 0.804s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:27 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 is being set with open permissions: ugo+rw Jun 26 22:22:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:27 devstack sudo[114128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 Jun 26 22:22:27 devstack sudo[114128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-ea790ea4-3b73-44de-a4b4-7b34eda98ee2-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-ea790ea4-3b73-44de-a4b4-7b34eda98ee2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-quobyte-ea790ea4-3b73-44de-a4b4-7b34eda98ee2" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-ea790ea4-3b73-44de-a4b4-7b34eda98ee2" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[781c0649-ddd9-4cde-bcca-caec7445e0fd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:28 devstack sudo[114126]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.684s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:28 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Deleted volume successfully. Jun 26 22:22:28 devstack sudo[114128]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1" returned: 0 in 0.680s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-119cd527-515e-4c85-90b4-75c427f6933b tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-04f07b3e-a543-414d-af04-bbd213d2acb8-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:28 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 Jun 26 22:22:28 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:28 devstack sudo[114133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.info Jun 26 22:22:28 devstack sudo[114133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:29 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2" returned: 0 in 0.755s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:29 devstack sudo[114133]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.info" returned: 0 in 0.660s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:29 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.info is being set with open permissions: ugo+rw Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:29 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2 Jun 26 22:22:29 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:29 devstack sudo[114141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.info Jun 26 22:22:29 devstack sudo[114141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:29 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ea790ea4-3b73-44de-a4b4-7b34eda98ee2" returned: 0 in 0.658s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:29 devstack sudo[114141]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.info" returned: 0 in 0.662s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.581s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-ea790ea4-3b73-44de-a4b4-7b34eda98ee2" released by "delete_volume" :: held 1.493s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.948s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88ad1a7-65d3-42ff-b481-4c9d242c5899,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3049e2a0d62345ca9efc543040b474ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:17Z,use_quota=True,user_id='e1687bd78af24bc5b29133aef8815e71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10dd7aa3-632f-416b-bf9a-925df2c3522e),volume_type_id=10dd7aa3-632f-416b-bf9a-925df2c3522e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Creating volume f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:29 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:29 devstack sudo[114146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 1073741824 Jun 26 22:22:29 devstack sudo[114146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:29 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-892c9766-4a24-4251-ada9-dd508fd6500e tempest-CreateVolumesFromSnapshotTest-1546409867 None] Create snapshot completed successfully Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Created reservations ['8a58db7a-ecfb-4a29-b7db-e25858f0c719', '1fb01801-16a9-4540-bc30-c2b41957c6ec', '499cedc9-7086-4f44-bb40-f252f515822b', 'f0d4eb6c-b4d7-42d2-9966-12ec8f3da7db'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:30 devstack sudo[114148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:30 devstack sudo[114148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-quobyte-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37d21dc-7aef-4951-8325-00b859094ef2]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:30 devstack sudo[114148]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:30 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Deleted volume successfully. Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb737301-7dc4-4679-9bde-bba6310e8f51 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-ea790ea4-3b73-44de-a4b4-7b34eda98ee2-delete_volume" released by "delete_volume" :: held 2.445s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:30 devstack sudo[114146]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 1073741824" returned: 0 in 0.915s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:30 devstack sudo[114156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 Jun 26 22:22:30 devstack sudo[114156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:30 devstack sudo[114158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 Jun 26 22:22:30 devstack sudo[114158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (1f453d97-823b-4511-8f14-fce29c3dd429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ac427e-7832-4d53-8ba1-9f705831661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25ac427e-7832-4d53-8ba1-9f705831661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1144216582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1de8d6-0c45-4b1e-8e10-45c12e485368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:31Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae40ad8-4d4d-49aa-a619-5aa66ffd2cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae40ad8-4d4d-49aa-a619-5aa66ffd2cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ac5e8d-ec7b-4cb2-abac-52bf1a49efa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1ac5e8d-ec7b-4cb2-abac-52bf1a49efa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f1de8d6-0c45-4b1e-8e10-45c12e485368', 'volume_name': 'volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f828e-a421-435d-beba-3310e0e7fb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (405f828e-a421-435d-beba-3310e0e7fb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceefc85b-0eaf-4a84-86ae-e253d5954958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:31 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume 0f1de8d6-0c45-4b1e-8e10-45c12e485368: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368', 'volume_size': 1} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:31 devstack sudo[114156]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0" returned: 0 in 0.944s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:31 devstack sudo[114158]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899" returned: 0 in 0.819s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:31 devstack sudo[114164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0 Jun 26 22:22:31 devstack sudo[114164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.674s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-172261769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=400fa87b-b4a4-4cab-90a8-6179a706ad40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:22Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Creating volume 400fa87b-b4a4-4cab-90a8-6179a706ad40 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:31 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:31 devstack sudo[114166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 1073741824 Jun 26 22:22:31 devstack sudo[114166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Attempting download of 89592d0b-e3c5-4f60-8e7c-a62e2b068345 ((None, [{'url': 'file:///opt/stack/data/glance/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'metadata': {}}])) to volume f88ad1a7-65d3-42ff-b481-4c9d242c5899. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a7ec67-1de4-4ae1-b3d3-ef96aaf0a43c]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89592d0b-e3c5-4f60-8e7c-a62e2b068345_3v16gqx5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (61b7dcd7-4816-4d50-8bc6-add159da29fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:32 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89592d0b-e3c5-4f60-8e7c-a62e2b068345_3v16gqx5 Jun 26 22:22:32 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66cf57-a031-459d-8556-db4c8eab768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f66cf57-a031-459d-8556-db4c8eab768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093874599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a221134-c422-4369-b650-24d81d3e557a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:32Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07923b9-1416-47d7-9671-c5a578abf762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07923b9-1416-47d7-9671-c5a578abf762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a48d8df-2e20-49f3-9710-d9b002becfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a48d8df-2e20-49f3-9710-d9b002becfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a221134-c422-4369-b650-24d81d3e557a', 'volume_name': 'volume-7a221134-c422-4369-b650-24d81d3e557a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3426cc0f-cc08-473b-ace5-6d8c7835b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3426cc0f-cc08-473b-ace5-6d8c7835b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949ca140-c5f6-434f-b651-b4b54b95d846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume 7a221134-c422-4369-b650-24d81d3e557a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a221134-c422-4369-b650-24d81d3e557a', 'volume_size': 1} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:32 devstack sudo[114164]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (e99dc227-e192-42ce-b89b-ec5f06e0174c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71ca452-4066-4942-9814-dcf7d07e2c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0" returned: 0 in 0.940s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0" released by "delete_volume" :: held 1.939s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71ca452-4066-4942-9814-dcf7d07e2c17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073105845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e3f18-41be-4951-971e-345a8118057e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:33Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af20d673-d71e-46d2-b575-6191e46edaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af20d673-d71e-46d2-b575-6191e46edaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3941d90-4533-481b-9742-e0a393082cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3941d90-4533-481b-9742-e0a393082cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19e3f18-41be-4951-971e-345a8118057e', 'volume_name': 'volume-a19e3f18-41be-4951-971e-345a8118057e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82713939-8050-49a1-9840-eed331d6ca1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82713939-8050-49a1-9840-eed331d6ca1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0484c4-8f33-491d-8ca0-eb8ff0566d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume a19e3f18-41be-4951-971e-345a8118057e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19e3f18-41be-4951-971e-345a8118057e', 'volume_size': 1} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Created reservations ['457f5b47-332b-47b5-97d5-92696ebec873', '62855890-6c2b-4b05-808a-16cd62dcfedf', 'aaebfe24-8a58-4224-8a06-87885a5d497d', '3fd57d5a-0a83-44e9-8548-c1d4f2582b39'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:32 devstack sudo[114166]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 1073741824" returned: 0 in 1.124s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:32 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_89592d0b-e3c5-4f60-8e7c-a62e2b068345_3v16gqx5" returned: 0 in 1.094s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:32 devstack sudo[114176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:32 devstack sudo[114176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89592d0b-e3c5-4f60-8e7c-a62e2b068345_3v16gqx5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:33 devstack sudo[114178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 Jun 26 22:22:33 devstack sudo[114178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-quobyte-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7" acquired by "delete_volume" :: waited 0.032s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ac57cc-26f0-45c3-83b6-a2bd49a52acc]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:33 devstack sudo[114179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89592d0b-e3c5-4f60-8e7c-a62e2b068345_3v16gqx5 Jun 26 22:22:33 devstack sudo[114179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (44c0db58-c8a1-472e-8d9a-e934ed7477a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06c04a9-b302-4040-a5b7-c24a9b005fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c06c04a9-b302-4040-a5b7-c24a9b005fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30854067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e505a03d-1d93-4153-8f13-94cd22eb849d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:33Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1516d726-c14f-436d-a3c5-26ad2498e02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1516d726-c14f-436d-a3c5-26ad2498e02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack sudo[114181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 Jun 26 22:22:33 devstack sudo[114181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920aa127-6d8e-4c10-b2a9-c86512031ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (920aa127-6d8e-4c10-b2a9-c86512031ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e505a03d-1d93-4153-8f13-94cd22eb849d', 'volume_name': 'volume-e505a03d-1d93-4153-8f13-94cd22eb849d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922b3d75-712b-4a3a-9af8-f0e33e184e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922b3d75-712b-4a3a-9af8-f0e33e184e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfe6780-d39f-4226-b125-178f86aeb9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume e505a03d-1d93-4153-8f13-94cd22eb849d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e505a03d-1d93-4153-8f13-94cd22eb849d', 'volume_size': 1} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (f6c131d2-e1a1-4e61-b865-ba7c144e99ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8862d046-2858-45c8-9fbc-96da5511d754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8862d046-2858-45c8-9fbc-96da5511d754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056010328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0141b7bc-1194-4efc-8bf1-26c43de669e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:34Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19579d5e-abbf-48a2-a9b9-243b021625b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19579d5e-abbf-48a2-a9b9-243b021625b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9660290c-c17d-488e-82de-9efb3f450741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9660290c-c17d-488e-82de-9efb3f450741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0141b7bc-1194-4efc-8bf1-26c43de669e5', 'volume_name': 'volume-0141b7bc-1194-4efc-8bf1-26c43de669e5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cebac0c-efa6-4bbb-abd6-e5f1039e7893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack sudo[114176]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cebac0c-efa6-4bbb-abd6-e5f1039e7893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c50421a-9f38-4afb-bf8e-7adc37fa7a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:33 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume 0141b7bc-1194-4efc-8bf1-26c43de669e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0141b7bc-1194-4efc-8bf1-26c43de669e5', 'volume_size': 1} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.899s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:33 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Deleted volume successfully. Jun 26 22:22:33 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-74b04767-ac95-44d7-aa3f-b5e1dde4d9ac tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-8ab8d5fd-4875-4d54-9f8d-b084e559a3e0-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:34 devstack sudo[114179]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:34 devstack sudo[114178]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89592d0b-e3c5-4f60-8e7c-a62e2b068345_3v16gqx5" returned: 1 in 1.055s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_89592d0b-e3c5-4f60-8e7c-a62e2b068345_3v16gqx5' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40" returned: 0 in 1.099s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9250a3ab-4e6d-4a7d-9283-06ea9e40a4b4]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.654s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1609852904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:22Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Creating volume 2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:34 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:34 devstack sudo[114190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd 1073741824 Jun 26 22:22:34 devstack sudo[114190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ccee6-3c73-4946-be4d-acdec9a87f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-400fa87b-b4a4-4cab-90a8-6179a706ad40', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a13429f-9005-43ac-800c-dd507f243648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:34 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 (400fa87b-b4a4-4cab-90a8-6179a706ad40): created successfully Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a13429f-9005-43ac-800c-dd507f243648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (5a2dc814-0b34-4f34-9cb7-be65ba797e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:34 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-92c86de0-3163-4b63-8b3c-61d24a5ceccb tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created volume successfully. Jun 26 22:22:34 devstack sudo[114192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD Jun 26 22:22:34 devstack sudo[114192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:34 devstack sudo[114181]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7" returned: 0 in 1.107s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:34 devstack sudo[114196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7 Jun 26 22:22:34 devstack sudo[114196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:34 devstack sudo[114192]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD" returned: 0 in 0.768s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:34 devstack sudo[114203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD Jun 26 22:22:34 devstack sudo[114203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:34 devstack sudo[114190]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd 1073741824" returned: 0 in 0.902s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:35 devstack sudo[114196]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7" returned: 0 in 0.731s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:35 devstack sudo[114207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd Jun 26 22:22:35 devstack sudo[114207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7" released by "delete_volume" :: held 1.912s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Created reservations ['99e48575-ee0f-45a4-8a95-0687713f5116', '0efe0948-61eb-45b7-9107-939bc0b8b49f', '52dda222-672e-400b-afb8-6c2923ac339c', '2ca1f4b9-fb28-4aa8-85b5-0d49d882b449'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:35 devstack sudo[114209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:35 devstack sudo[114209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:35 devstack sudo[114203]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] 89592d0b-e3c5-4f60-8e7c-a62e2b068345 was raw, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:35 devstack sudo[114207]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd" returned: 0 in 0.682s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] <== create_volume: return (1634ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.636s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.862s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1650043537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af506e69-53a4-43cc-a38b-56855f521e3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:23Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Creating volume af506e69-53a4-43cc-a38b-56855f521e3b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:35 devstack sudo[114215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:35 devstack sudo[114215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:35 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3def368-6b9b-41a8-abed-8a0c822f7a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:35 devstack sudo[114217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b 1073741824 Jun 26 22:22:35 devstack sudo[114217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab11e7cd-bf51-4c70-bd72-fb8390664b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:35 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd (2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd): created successfully Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab11e7cd-bf51-4c70-bd72-fb8390664b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (c4f72c88-b59d-44f1-a6ce-d87967303f8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ba92573e-89d1-4778-9ebd-5f9c03bbc4dd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created volume successfully. Jun 26 22:22:35 devstack sudo[114209]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.735s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Deleted volume successfully. Jun 26 22:22:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-c228477e-0edd-4c22-9ac4-44483e0d9c81 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-d4957c1f-6a59-4d51-a60d-9a27f1dd20c7-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-935f5b53-07a4-4591-928a-95466878ff84-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-935f5b53-07a4-4591-928a-95466878ff84-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "cinder-quobyte-935f5b53-07a4-4591-928a-95466878ff84" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-935f5b53-07a4-4591-928a-95466878ff84" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca82a17-e522-4468-86fa-cd14ea7c02dd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:36 devstack sudo[114215]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899" returned: 0 in 0.806s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_89592d0b-e3c5-4f60-8e7c-a62e2b068345_8pd194cfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:22:36 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Converted 0.00 MB image at 0.00 MB/s Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:36 devstack sudo[114226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 Jun 26 22:22:36 devstack sudo[114226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:36 devstack sudo[114228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 1G Jun 26 22:22:36 devstack sudo[114228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:36 devstack sudo[114217]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b 1073741824" returned: 0 in 0.933s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:36 devstack sudo[114230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b Jun 26 22:22:36 devstack sudo[114230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:37 devstack sudo[114226]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84" returned: 0 in 0.875s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:37 devstack sudo[114238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84 Jun 26 22:22:37 devstack sudo[114238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:37 devstack sudo[114228]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 1G" returned: 0 in 0.760s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3bdab-13dc-4097-a2a7-65cdd76e4967]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:37 devstack sudo[114230]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b" returned: 0 in 0.697s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.125s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-629686009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2190f691-2f0f-4e89-868f-16cb26159405,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:23Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Creating volume 2190f691-2f0f-4e89-868f-16cb26159405 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:37 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:37 devstack sudo[114241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 Jun 26 22:22:37 devstack sudo[114241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc1f2132-ccc2-4d33-894d-5268e269b8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af506e69-53a4-43cc-a38b-56855f521e3b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88694315-1904-4cba-babc-523627fd9dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:37 devstack sudo[114243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 1073741824 Jun 26 22:22:37 devstack sudo[114243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:37 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume volume-af506e69-53a4-43cc-a38b-56855f521e3b (af506e69-53a4-43cc-a38b-56855f521e3b): created successfully Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88694315-1904-4cba-babc-523627fd9dc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (9f56075c-6a85-4980-ae09-6ca58d1a4102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:37 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-6fc85778-9552-49d5-8df6-98f6426fc742 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created volume successfully. Jun 26 22:22:37 devstack sudo[114238]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-935f5b53-07a4-4591-928a-95466878ff84" returned: 0 in 0.701s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-quobyte-935f5b53-07a4-4591-928a-95466878ff84" released by "delete_volume" :: held 1.624s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:37 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Created reservations ['203d5b42-1024-4dfc-83e5-c76a0eb9cd95', '3ed17387-efcb-4d22-a6d3-2d42297428e3', '8c426acf-23f7-4a84-adab-2a4cd749ad78', '97e07838-9b38-40b0-9e3b-d4c6683ca8a0'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:38 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:38 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:38 devstack sudo[114241]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899" returned: 0 in 0.835s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:38 devstack sudo[114253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 Jun 26 22:22:38 devstack sudo[114253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:38 devstack sudo[114243]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 1073741824" returned: 0 in 0.928s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:38 devstack sudo[114256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 Jun 26 22:22:38 devstack sudo[114256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:38 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.757s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Deleted volume successfully. Jun 26 22:22:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-ec965b6b-db93-4e0c-ad6c-a5edc0fcdc84 tempest-CreateVolumesFromImageTest-2063162272 None] Lock "cinder-935f5b53-07a4-4591-928a-95466878ff84-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:39 devstack sudo[114253]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899" returned: 1 in 1.032s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Downloaded image 89592d0b-e3c5-4f60-8e7c-a62e2b068345 ((None, [{'url': 'file:///opt/stack/data/glance/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'metadata': {}}])) to volume f88ad1a7-65d3-42ff-b481-4c9d242c5899 successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Temporary image 89592d0b-e3c5-4f60-8e7c-a62e2b068345 for user e1687bd78af24bc5b29133aef8815e71 is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Marking volume f88ad1a7-65d3-42ff-b481-4c9d242c5899 as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Copying metadata from image 89592d0b-e3c5-4f60-8e7c-a62e2b068345 to f88ad1a7-65d3-42ff-b481-4c9d242c5899. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Creating volume glance metadata for volume f88ad1a7-65d3-42ff-b481-4c9d242c5899 backed by image 89592d0b-e3c5-4f60-8e7c-a62e2b068345 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6d485d18717ad89f6ebbd25b7269937c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:22:39 devstack sudo[114256]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405" returned: 0 in 0.820s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.593s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-268794946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31b44c53-244d-4534-ac19-0bbf415cb497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='430ab90cb50a4625a1ca6f9229b31479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:23Z,use_quota=True,user_id='ff5755237be548c885043b3eebc1d5de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Creating volume 31b44c53-244d-4534-ac19-0bbf415cb497 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:39 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:39 devstack sudo[114263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 1073741824 Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3693678-47ec-449d-8506-b18898db16c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2190f691-2f0f-4e89-868f-16cb26159405', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:39 devstack sudo[114263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5049baef-2767-4a79-95fa-c17763946107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume volume-2190f691-2f0f-4e89-868f-16cb26159405 (2190f691-2f0f-4e89-868f-16cb26159405): created successfully Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5049baef-2767-4a79-95fa-c17763946107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (b6b8126b-14aa-4440-bf74-bc3de91d9471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d380e89a-26be-428f-8ac1-9dee89d2aef5 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created volume successfully. Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (689075af-a989-41b5-96ed-cb126567c236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899', 'volume_size': 1, 'image_id': '89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6d485d18717ad89f6ebbd25b7269937c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3049e2a0d62345ca9efc543040b474ef', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'a49bfba583467e5afca104867e07b2e5b0597082afb1d912ae5c0e6230c5a6a61213ea2c9c8a4ccd206cc94d8cd9b81102cbf40b045b084b3ee1fb7b0579f42b', 'id': '89592d0b-e3c5-4f60-8e7c-a62e2b068345', 'created_at': datetime.datetime(2026, 6, 26, 20, 22, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 22, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/89592d0b-e3c5-4f60-8e7c-a62e2b068345/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4a531-40d8-4844-816d-e94e3bf064a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Volume volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 (f88ad1a7-65d3-42ff-b481-4c9d242c5899): created successfully Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7c4a531-40d8-4844-816d-e94e3bf064a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Flow 'volume_create_manager' (1a0a486e-328f-46d3-98fb-7bbc4c206481) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:39 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-58374d62-6360-406a-bec8-0c2abc30c29c tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Created volume successfully. Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Acquiring lock "cinder-f88ad1a7-65d3-42ff-b481-4c9d242c5899-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "cinder-f88ad1a7-65d3-42ff-b481-4c9d242c5899-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Acquiring lock "cinder-quobyte-f88ad1a7-65d3-42ff-b481-4c9d242c5899" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "cinder-quobyte-f88ad1a7-65d3-42ff-b481-4c9d242c5899" acquired by "delete_volume" :: waited 0.028s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b9b222-8dcf-445d-a6ae-149cd9c702a8]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:40 devstack sudo[114269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 Jun 26 22:22:40 devstack sudo[114269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:40 devstack sudo[114263]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 1073741824" returned: 0 in 1.052s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:40 devstack sudo[114272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 Jun 26 22:22:40 devstack sudo[114272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:40 devstack sudo[114269]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899" returned: 0 in 0.829s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:40 devstack sudo[114276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 Jun 26 22:22:40 devstack sudo[114276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:41 devstack sudo[114272]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497" returned: 0 in 0.733s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.413s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1144216582',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1de8d6-0c45-4b1e-8e10-45c12e485368,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:31Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Creating volume 0f1de8d6-0c45-4b1e-8e10-45c12e485368 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:41 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b3b672-0fac-40e1-8d12-baf3c145c2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31b44c53-244d-4534-ac19-0bbf415cb497', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:41 devstack sudo[114279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 1073741824 Jun 26 22:22:41 devstack sudo[114279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce6b73a-640a-4dfb-8570-11220e2460b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:41 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Volume volume-31b44c53-244d-4534-ac19-0bbf415cb497 (31b44c53-244d-4534-ac19-0bbf415cb497): created successfully Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ce6b73a-640a-4dfb-8570-11220e2460b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Flow 'volume_create_manager' (96b20414-a6d1-4043-aaf6-fbdf88e6cda9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:41 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-38d61121-e7ff-4b8e-b332-677adee5e1bd tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created volume successfully. Jun 26 22:22:41 devstack sudo[114276]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899" returned: 1 in 0.844s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:41 devstack sudo[114284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899 Jun 26 22:22:41 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Flow 'volume_create_manager' (9730da4c-c482-4a6b-9bce-f89c874dd7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0ceb73-93a2-4da5-a143-4f7bf33868d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e0ceb73-93a2-4da5-a143-4f7bf33868d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144719461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94ef4a6-5283-41ba-bf56-d92f8f3f7144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf8269f4846457d9c253f4414359881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:42Z,use_quota=True,user_id='f42d0040fd254939841c7a22a2c50807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b52bde-6052-4ac1-a7bd-c00331720145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7b52bde-6052-4ac1-a7bd-c00331720145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41bbe37-bd1f-407c-aff1-7975f8931309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e41bbe37-bd1f-407c-aff1-7975f8931309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f94ef4a6-5283-41ba-bf56-d92f8f3f7144', 'volume_name': 'volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9795db28-b249-4fa2-9408-b05d6d9ab3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:41 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9795db28-b249-4fa2-9408-b05d6d9ab3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db8b748-6445-49d8-aa4f-b729e52444de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:42 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Volume f94ef4a6-5283-41ba-bf56-d92f8f3f7144: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144', 'volume_size': 1} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:42 devstack sudo[114279]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 1073741824" returned: 0 in 0.997s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-31b44c53-244d-4534-ac19-0bbf415cb497-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:42 devstack sudo[114290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 Jun 26 22:22:42 devstack sudo[114290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-31b44c53-244d-4534-ac19-0bbf415cb497-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-quobyte-31b44c53-244d-4534-ac19-0bbf415cb497" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-31b44c53-244d-4534-ac19-0bbf415cb497" acquired by "delete_volume" :: waited 0.016s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[1008d26a-b51b-4a30-96ca-7058d3cd0a45]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:42 devstack sudo[114293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 Jun 26 22:22:42 devstack sudo[114293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:42 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f88ad1a7-65d3-42ff-b481-4c9d242c5899" returned: 0 in 0.789s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "cinder-quobyte-f88ad1a7-65d3-42ff-b481-4c9d242c5899" released by "delete_volume" :: held 2.559s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Created reservations ['a2fe5486-e5c1-464a-b4fc-1d38d2ae097f', 'd8baa504-0c8f-4033-a582-55ccf14f1c28', 'a6c3435c-fe99-465b-ae13-6a231cb8381a', 'fd7b6fd3-2732-4b6a-8599-dba54a5589df'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:42 devstack sudo[114295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:42 devstack sudo[114295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:42 devstack sudo[114290]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368" returned: 0 in 0.726s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.664s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2093874599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a221134-c422-4369-b650-24d81d3e557a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:32Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Creating volume 7a221134-c422-4369-b650-24d81d3e557a {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:42 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceefc85b-0eaf-4a84-86ae-e253d5954958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8744e3-2e88-4dae-a537-f066e519d16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:42 devstack sudo[114298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a 1073741824 Jun 26 22:22:42 devstack sudo[114298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:42 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 (0f1de8d6-0c45-4b1e-8e10-45c12e485368): created successfully Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb8744e3-2e88-4dae-a537-f066e519d16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:42 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (1f453d97-823b-4511-8f14-fce29c3dd429) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:42 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-40cc684b-b9eb-4c8e-aac9-3c22aedbd20f tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created volume successfully. Jun 26 22:22:43 devstack sudo[114293]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497" returned: 0 in 0.844s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:43 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497 Jun 26 22:22:43 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:43 devstack sudo[114295]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.767s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:43 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Deleted volume successfully. Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-0cc9e9f8-7d36-4d1b-bd73-599b1c095b99 tempest-VolumeAndVolumeTypeFromImageTest-704593527 None] Lock "cinder-f88ad1a7-65d3-42ff-b481-4c9d242c5899-delete_volume" released by "delete_volume" :: held 3.603s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:43 devstack sudo[114298]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a 1073741824" returned: 0 in 1.032s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:43 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-31b44c53-244d-4534-ac19-0bbf415cb497" returned: 0 in 0.830s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:43 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a Jun 26 22:22:43 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:43 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-31b44c53-244d-4534-ac19-0bbf415cb497" released by "delete_volume" :: held 1.722s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created reservations ['db36d606-3053-4561-98c5-c5a6a4df7793', '70029bf1-9b0f-4feb-b62d-4c6bbb75a7eb', '76162b8f-a87a-40bc-bfd6-3d70aab80259', '76752217-9ba8-4420-82de-c17fd116b71f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:44 devstack sudo[114318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:44 devstack sudo[114318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-2190f691-2f0f-4e89-868f-16cb26159405-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-2190f691-2f0f-4e89-868f-16cb26159405-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-quobyte-2190f691-2f0f-4e89-868f-16cb26159405" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-2190f691-2f0f-4e89-868f-16cb26159405" acquired by "delete_volume" :: waited 0.018s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e279606-9bb5-4ae0-b94f-a9fc04e187b6]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:44 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a" returned: 0 in 0.781s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] <== create_volume: return (1876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.879s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2073105845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e3f18-41be-4951-971e-345a8118057e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:33Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Creating volume a19e3f18-41be-4951-971e-345a8118057e {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:44 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (949ca140-c5f6-434f-b651-b4b54b95d846) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a221134-c422-4369-b650-24d81d3e557a', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac76cf6-6fc8-47a2-ab1a-bcd4bad1068c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:44 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume volume-7a221134-c422-4369-b650-24d81d3e557a (7a221134-c422-4369-b650-24d81d3e557a): created successfully Jun 26 22:22:44 devstack sudo[114322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e 1073741824 Jun 26 22:22:44 devstack sudo[114322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac76cf6-6fc8-47a2-ab1a-bcd4bad1068c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:44 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (61b7dcd7-4816-4d50-8bc6-add159da29fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:44 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-989a4825-c500-4e8a-9c6b-a39b65964a15 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created volume successfully. Jun 26 22:22:44 devstack sudo[114321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 Jun 26 22:22:44 devstack sudo[114321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:45 devstack sudo[114318]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.937s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:45 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:45 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Deleted volume successfully. Jun 26 22:22:45 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-166229f7-d79c-4707-a18e-f0003036be6f tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-31b44c53-244d-4534-ac19-0bbf415cb497-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:45 devstack sudo[114321]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405" returned: 0 in 0.986s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:45 devstack sudo[114333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405 Jun 26 22:22:45 devstack sudo[114333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:45 devstack sudo[114322]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e 1073741824" returned: 0 in 1.173s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:46 devstack sudo[114336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e Jun 26 22:22:46 devstack sudo[114336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:46 devstack sudo[114333]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:46 devstack sudo[114339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2190f691-2f0f-4e89-868f-16cb26159405" returned: 0 in 0.754s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:46 devstack sudo[114339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-2190f691-2f0f-4e89-868f-16cb26159405" released by "delete_volume" :: held 1.812s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created reservations ['8a546ce7-5ce5-4ff4-bc92-8af6b5d64353', 'e11ba1ac-bbf0-4a83-98e6-b2f98e4298a8', 'e080ae05-1782-4ace-85fe-a01a7bc08305', 'd56ae4fe-5205-4b1a-8de4-02a0e83314ed'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:46 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:46 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:46 devstack sudo[114336]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e" returned: 0 in 0.813s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] <== create_volume: return (2064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.067s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.331s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30854067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e505a03d-1d93-4153-8f13-94cd22eb849d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:33Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Creating volume e505a03d-1d93-4153-8f13-94cd22eb849d {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:46 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e0484c4-8f33-491d-8ca0-eb8ff0566d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19e3f18-41be-4951-971e-345a8118057e', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:46 devstack sudo[114344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d 1073741824 Jun 26 22:22:46 devstack sudo[114344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc99e39-2482-46da-a6ff-e4399a8d5270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-af506e69-53a4-43cc-a38b-56855f521e3b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:46 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume volume-a19e3f18-41be-4951-971e-345a8118057e (a19e3f18-41be-4951-971e-345a8118057e): created successfully Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc99e39-2482-46da-a6ff-e4399a8d5270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (e99dc227-e192-42ce-b89b-ec5f06e0174c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:46 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-af506e69-53a4-43cc-a38b-56855f521e3b-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:46 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-78d28a66-d695-404d-a9c6-c9ec15c59a71 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created volume successfully. Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-quobyte-af506e69-53a4-43cc-a38b-56855f521e3b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-af506e69-53a4-43cc-a38b-56855f521e3b" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[87974754-02c8-44b2-84eb-81e1585294a1]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:47 devstack sudo[114346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b Jun 26 22:22:47 devstack sudo[114346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:47 devstack sudo[114339]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.932s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:22:47 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.958s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:47 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Deleted volume successfully. Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-776a93f3-012a-4f75-9f92-9a683ebff59e tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-2190f691-2f0f-4e89-868f-16cb26159405-delete_volume" released by "delete_volume" :: held 3.106s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:47 devstack sudo[114344]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d 1073741824" returned: 0 in 1.114s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:47 devstack sudo[114358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d Jun 26 22:22:47 devstack sudo[114358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:48 devstack sudo[114346]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b" returned: 0 in 0.908s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:48 devstack sudo[114360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b Jun 26 22:22:48 devstack sudo[114360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:48 devstack sudo[114358]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d" returned: 0 in 0.699s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.844s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2056010328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0141b7bc-1194-4efc-8bf1-26c43de669e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55ee95e245e2448f9b5802a34fb4027f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:34Z,use_quota=True,user_id='9a80a9cfb3ce42cea066916ea388ab3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Creating volume 0141b7bc-1194-4efc-8bf1-26c43de669e5 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:48 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:48 devstack sudo[114360]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-af506e69-53a4-43cc-a38b-56855f521e3b" returned: 0 in 0.694s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:48 devstack sudo[114364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 1073741824 Jun 26 22:22:48 devstack sudo[114364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbfe6780-d39f-4226-b125-178f86aeb9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e505a03d-1d93-4153-8f13-94cd22eb849d', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c9687e-e52b-4ed4-a4b3-f0fe5f24f1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-af506e69-53a4-43cc-a38b-56855f521e3b" released by "delete_volume" :: held 1.681s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:48 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume volume-e505a03d-1d93-4153-8f13-94cd22eb849d (e505a03d-1d93-4153-8f13-94cd22eb849d): created successfully Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c9687e-e52b-4ed4-a4b3-f0fe5f24f1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (44c0db58-c8a1-472e-8d9a-e934ed7477a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:48 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d002ec84-8a85-420d-8e43-848b9747a8b4 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created volume successfully. Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created reservations ['1709f29b-84a8-43d7-bd22-3566efa098a7', '8b77d55b-814b-4869-9b0a-f588647ebf4b', 'e576a3fa-59fe-4d2c-805f-fc5f0e486985', '8775bcd7-6fb9-4025-931f-f222e5aa5529'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:48 devstack sudo[114366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:48 devstack sudo[114366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-quobyte-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e665e5-ee0d-4660-af93-511e17bf0512]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:49 devstack sudo[114371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd Jun 26 22:22:49 devstack sudo[114371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:49 devstack sudo[114366]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.799s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:49 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Deleted volume successfully. Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-5fa8e50f-5e5c-4e57-ae9d-fd9d035dd268 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-af506e69-53a4-43cc-a38b-56855f521e3b-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:49 devstack sudo[114364]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 1073741824" returned: 0 in 1.062s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:49 devstack sudo[114375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 Jun 26 22:22:49 devstack sudo[114375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:50 devstack sudo[114371]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd" returned: 0 in 0.864s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:50 devstack sudo[114380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd Jun 26 22:22:50 devstack sudo[114380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:50 devstack sudo[114375]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5" returned: 0 in 0.690s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.814s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.492s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-144719461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f94ef4a6-5283-41ba-bf56-d92f8f3f7144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf8269f4846457d9c253f4414359881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:42Z,use_quota=True,user_id='f42d0040fd254939841c7a22a2c50807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Creating volume f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:50 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c50421a-9f38-4afb-bf8e-7adc37fa7a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0141b7bc-1194-4efc-8bf1-26c43de669e5', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:50 devstack sudo[114383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 1073741824 Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534a74f4-08b8-45b3-a577-ab2b0599710b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:50 devstack sudo[114383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:50 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Volume volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 (0141b7bc-1194-4efc-8bf1-26c43de669e5): created successfully Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (534a74f4-08b8-45b3-a577-ab2b0599710b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Flow 'volume_create_manager' (f6c131d2-e1a1-4e61-b865-ba7c144e99ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:50 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1bc511fa-1a71-41a7-b147-557368702413 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created volume successfully. Jun 26 22:22:50 devstack sudo[114380]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd" returned: 0 in 0.713s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:50 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd" released by "delete_volume" :: held 1.634s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created reservations ['92110688-7219-4826-b6d2-8be20bb5f666', '9f22f12a-ce03-42c4-ad9f-4bd4f4f290f1', '80e6e879-94da-4c5b-bace-4b11b2993960', '61fd0fcf-1d19-444c-aa2a-f85f91052a1b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:51 devstack sudo[114388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:51 devstack sudo[114388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-0141b7bc-1194-4efc-8bf1-26c43de669e5-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-0141b7bc-1194-4efc-8bf1-26c43de669e5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Flow 'volume_create_manager' (1ebd88fb-35a9-42e0-8cd7-13282e51d32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96540f05-b05a-4974-b1f9-d9e959b1b25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-0141b7bc-1194-4efc-8bf1-26c43de669e5" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96540f05-b05a-4974-b1f9-d9e959b1b25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da54334f-eef0-41df-ae77-abd7d06bc3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc495f2672ee4595ae24ca5c5e006116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:51Z,use_quota=True,user_id='3a92b0d832e74ccc82ebf43f12fbce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effaf6eb-7e2d-4b77-bdac-f9a534ce7c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effaf6eb-7e2d-4b77-bdac-f9a534ce7c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed0efbd-fa3c-40c8-b708-9580b8d88f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.image.glance [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Creating Keystone auth plugin from conf {{(pid=93616) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-400fa87b-b4a4-4cab-90a8-6179a706ad40-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:51 devstack sudo[114383]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-0141b7bc-1194-4efc-8bf1-26c43de669e5" acquired by "delete_volume" :: waited 0.065s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 1073741824" returned: 0 in 1.084s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-400fa87b-b4a4-4cab-90a8-6179a706ad40-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0515d57-9478-4767-8faa-af3b8270c320]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-quobyte-400fa87b-b4a4-4cab-90a8-6179a706ad40" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:51 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 Jun 26 22:22:51 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-400fa87b-b4a4-4cab-90a8-6179a706ad40" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7edfe6b-1e19-4f7a-837a-4932023fdc4d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:51 devstack sudo[114391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 Jun 26 22:22:51 devstack sudo[114391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:51 devstack sudo[114394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 Jun 26 22:22:51 devstack sudo[114394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ed0efbd-fa3c-40c8-b708-9580b8d88f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'da54334f-eef0-41df-ae77-abd7d06bc3b9', 'volume_name': 'volume-da54334f-eef0-41df-ae77-abd7d06bc3b9', 'volume_size': 1, 'image_id': 'd03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e75c5c5c58430d536c9bf7e365baddb4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc495f2672ee4595ae24ca5c5e006116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '547d3079f469022eb6da36e540226010cf4f9a6e4eddd5ad816b8949b22ba8e8eb9d2fdc3cbbfef060dad5f606cad2c62e21f57f1a1695269926fa975d5388bd', 'id': 'd03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'created_at': datetime.datetime(2026, 6, 26, 20, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71/file', 'properties': {}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6c67d1-7b79-48af-aa80-00e56ab99070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed6c67d1-7b79-48af-aa80-00e56ab99070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9888b4f1-e75c-4c94-b33b-d03e3a399e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:51 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Volume da54334f-eef0-41df-ae77-abd7d06bc3b9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-da54334f-eef0-41df-ae77-abd7d06bc3b9', 'volume_size': 1, 'image_id': 'd03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e75c5c5c58430d536c9bf7e365baddb4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc495f2672ee4595ae24ca5c5e006116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '547d3079f469022eb6da36e540226010cf4f9a6e4eddd5ad816b8949b22ba8e8eb9d2fdc3cbbfef060dad5f606cad2c62e21f57f1a1695269926fa975d5388bd', 'id': 'd03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'created_at': datetime.datetime(2026, 6, 26, 20, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71/file', 'properties': {}}, 'image_service': } Jun 26 22:22:51 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Trying to clone da54334f-eef0-41df-ae77-abd7d06bc3b9 from image d03d3650-e7f9-4d55-bc57-72a97e2e5d71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'metadata': {}}]). {{(pid=93616) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 26 22:22:52 devstack sudo[114388]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.989s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Deleted volume successfully. Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 26 22:22:52 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Image download 0.00 MB at 0.00 MB/s Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-157b5f0f-1915-4fb2-98c3-452222a3e258 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-2409924c-e1dc-4c8b-8fcf-d4ba3b24cfcd-delete_volume" released by "delete_volume" :: held 2.900s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e41ac7-faac-451c-869a-ab89ab7fa698]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:52 devstack sudo[114398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD Jun 26 22:22:52 devstack sudo[114398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:52 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" returned: 0 in 0.912s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.092s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:52 devstack sudo[114391]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5" returned: 0 in 0.983s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:52 devstack sudo[114407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5 Jun 26 22:22:52 devstack sudo[114407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1db8b748-6445-49d8-aa4f-b729e52444de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:52 devstack sudo[114394]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71622870-25f0-4d70-be5c-58c76ae59409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40" returned: 0 in 0.911s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:52 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Volume volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 (f94ef4a6-5283-41ba-bf56-d92f8f3f7144): created successfully Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71622870-25f0-4d70-be5c-58c76ae59409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:22:52 devstack sudo[114409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40 Jun 26 22:22:52 devstack sudo[114409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:52 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Flow 'volume_create_manager' (9730da4c-c482-4a6b-9bce-f89c874dd7fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:22:52 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c269b9c7-715f-4073-826b-1b37304d74fd tempest-VolumeDependencyTests-1638096603 None] Created volume successfully. Jun 26 22:22:53 devstack sudo[114398]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD" returned: 0 in 0.841s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:53 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD Jun 26 22:22:53 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:53 devstack sudo[114407]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0141b7bc-1194-4efc-8bf1-26c43de669e5" returned: 0 in 0.686s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-0141b7bc-1194-4efc-8bf1-26c43de669e5" released by "delete_volume" :: held 1.728s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:53 devstack sudo[114409]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-400fa87b-b4a4-4cab-90a8-6179a706ad40" returned: 0 in 0.669s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-400fa87b-b4a4-4cab-90a8-6179a706ad40" released by "delete_volume" :: held 1.623s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created reservations ['242455f7-40db-4273-9047-3279f2d08828', '238ffd42-6735-4267-9db9-7c06c6c2175f', '4b77c5b5-9053-4062-803a-a5c61f434102', '7d0c88fd-7b1a-48fe-a7d0-0c13c4b66f3b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created reservations ['50ad40eb-c1f9-4bb9-9156-bae8413d0626', '1317cfde-c2ce-4ad6-a4b0-61501c2c9f95', '8eb55d8a-b515-49ac-8979-a2e4d74901c0', '757e183d-449b-407c-905c-0b7980976827'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:53 devstack sudo[114417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:53 devstack sudo[114417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:53 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:53 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-e505a03d-1d93-4153-8f13-94cd22eb849d-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-e505a03d-1d93-4153-8f13-94cd22eb849d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-e505a03d-1d93-4153-8f13-94cd22eb849d" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-e505a03d-1d93-4153-8f13-94cd22eb849d" acquired by "delete_volume" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-cb950a1b-89cd-43f6-aedd-2aee6b451d85-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b49d82-b025-426e-94bd-3bc15d419b85]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-cb950a1b-89cd-43f6-aedd-2aee6b451d85-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "cinder-quobyte-cb950a1b-89cd-43f6-aedd-2aee6b451d85" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:54 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD" returned: 1 in 0.985s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Temporary image d03d3650-e7f9-4d55-bc57-72a97e2e5d71 is fetched for user 3a92b0d832e74ccc82ebf43f12fbce92. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-cb950a1b-89cd-43f6-aedd-2aee6b451d85" acquired by "delete_volume" :: waited 0.043s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:54 devstack sudo[114424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d Jun 26 22:22:54 devstack sudo[114424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7192161-2a05-4192-95fd-52f12cea8ef4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9db72f-72b4-42e9-a018-45ff76886f40]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Creating offline snapshot 50bf90b0-843f-4a09-9fa4-8674d85ff1d5 of volume f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[31556a5c-caea-4e5c-8e49-52b19dd0aedf]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:54 devstack sudo[114426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 Jun 26 22:22:54 devstack sudo[114426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:54 devstack sudo[114427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD Jun 26 22:22:54 devstack sudo[114427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:54 devstack sudo[114429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 Jun 26 22:22:54 devstack sudo[114429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:54 devstack sudo[114417]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.242s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:54 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Deleted volume successfully. Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.207s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Deleted volume successfully. Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-009366c4-9fc1-47f7-a319-496fdd93eac5 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-0141b7bc-1194-4efc-8bf1-26c43de669e5-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7ab26e1f-8a72-4d66-a500-10e054cbeab4 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-400fa87b-b4a4-4cab-90a8-6179a706ad40-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:54 devstack sudo[114424]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d" returned: 0 in 1.090s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:55 devstack sudo[114437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d Jun 26 22:22:55 devstack sudo[114437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:55 devstack sudo[114426]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85" returned: 0 in 1.111s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:55 devstack sudo[114447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85 Jun 26 22:22:55 devstack sudo[114447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:55 devstack sudo[114427]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD" returned: 0 in 1.126s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:55 devstack sudo[114429]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" returned: 0 in 1.082s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:55 devstack sudo[114451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 1G Jun 26 22:22:55 devstack sudo[114451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:55 devstack sudo[114450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD Jun 26 22:22:55 devstack sudo[114450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:55 devstack sudo[114437]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-e505a03d-1d93-4153-8f13-94cd22eb849d" returned: 0 in 0.793s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-e505a03d-1d93-4153-8f13-94cd22eb849d" released by "delete_volume" :: held 1.967s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created reservations ['d918d90d-f95f-4b53-9ab0-640c3329587c', 'e44b0568-40db-4d80-840d-282f69f4373e', 'a73dd302-204c-464e-97fa-42f85e7bc635', 'fbbb277e-5760-43cb-b30d-496eb733933d'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:55 devstack sudo[114456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:55 devstack sudo[114456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:55 devstack sudo[114447]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-cb950a1b-89cd-43f6-aedd-2aee6b451d85" returned: 0 in 0.736s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-quobyte-cb950a1b-89cd-43f6-aedd-2aee6b451d85" released by "delete_volume" :: held 1.956s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-a19e3f18-41be-4951-971e-345a8118057e-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-a19e3f18-41be-4951-971e-345a8118057e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Created reservations ['60ad517d-ed88-4b34-9594-3f53963c8717', '20d663a7-aad3-41ef-96e1-509b6e3ad36a', 'd8387eb0-72fa-40cb-acc6-0db091a998bf', 'a386812f-54a9-4d01-a4f0-6c2ee72c62f0'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-a19e3f18-41be-4951-971e-345a8118057e" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-a19e3f18-41be-4951-971e-345a8118057e" acquired by "delete_volume" :: waited 0.042s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[8abff18f-932b-467f-a15b-0d5f2d7b4bef]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:56 devstack sudo[114450]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD" returned: 1 in 0.934s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:56 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:56 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:56 devstack sudo[114465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e Jun 26 22:22:56 devstack sudo[114465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:56 devstack sudo[114451]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 1G" returned: 0 in 1.020s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:56 devstack sudo[114470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 Jun 26 22:22:56 devstack sudo[114470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:56 devstack sudo[114456]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.785s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Deleted volume successfully. Jun 26 22:22:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-defadaaa-68ac-41ac-a813-d0c37f31a730 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-e505a03d-1d93-4153-8f13-94cd22eb849d-delete_volume" released by "delete_volume" :: held 3.075s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:57 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.727s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:57 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Deleted volume successfully. Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1a76a1b-d845-4691-a6c8-a14d83a2b598 tempest-CreateVolumesFromSourceVolumeTest-1226805030 None] Lock "cinder-cb950a1b-89cd-43f6-aedd-2aee6b451d85-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:57 devstack sudo[114465]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e" returned: 0 in 0.918s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:57 devstack sudo[114470]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5" returned: 0 in 0.765s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:57 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 is being set with open permissions: ugo+rw Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:57 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e Jun 26 22:22:57 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:57 devstack sudo[114482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 Jun 26 22:22:57 devstack sudo[114482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:57 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-a19e3f18-41be-4951-971e-345a8118057e" returned: 0 in 0.726s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-a19e3f18-41be-4951-971e-345a8118057e" released by "delete_volume" :: held 1.707s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:57 devstack sudo[114482]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5" returned: 0 in 0.731s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:57 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:57 devstack sudo[114486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.info Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created reservations ['f069566c-2739-4ee3-b500-31a044c78155', 'f1d17dbb-8d2f-44eb-a02b-1ea5df86eacc', '8c79b993-3c63-4f22-a486-b195f00575f8', '56e733f6-566f-47b8-990a-ba387fd26e8c'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:22:57 devstack sudo[114486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:58 devstack sudo[114488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:22:58 devstack sudo[114488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-7a221134-c422-4369-b650-24d81d3e557a-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-7a221134-c422-4369-b650-24d81d3e557a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-7a221134-c422-4369-b650-24d81d3e557a" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-7a221134-c422-4369-b650-24d81d3e557a" acquired by "delete_volume" :: waited 0.039s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5b7219-9401-4f09-8b77-f5ced8db102f]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:58 devstack sudo[114486]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:58 devstack sudo[114490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a Jun 26 22:22:58 devstack sudo[114490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.info" returned: 0 in 0.737s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:58 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.info is being set with open permissions: ugo+rw Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:58 devstack sudo[114493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.info Jun 26 22:22:58 devstack sudo[114493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:58 devstack sudo[114488]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.865s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:22:58 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Deleted volume successfully. Jun 26 22:22:58 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-e9d0aef9-6635-479b-8249-5fa52d575988 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-a19e3f18-41be-4951-971e-345a8118057e-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:22:59 devstack sudo[114490]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a" returned: 0 in 0.885s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:59 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a Jun 26 22:22:59 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:59 devstack sudo[114493]: pam_unix(sudo:session): session closed for user root Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.info" returned: 0 in 0.765s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.255s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.231s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:22:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da54334f-eef0-41df-ae77-abd7d06bc3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc495f2672ee4595ae24ca5c5e006116',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:22:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:22:51Z,use_quota=True,user_id='3a92b0d832e74ccc82ebf43f12fbce92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Creating volume da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:22:59 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:22:59 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:22:59 devstack sudo[114502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 1073741824 Jun 26 22:22:59 devstack sudo[114502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:22:59 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-97317eb1-7ff0-4c12-94b3-ec5474e6ca33 tempest-VolumeDependencyTests-1638096603 None] Create snapshot completed successfully Jun 26 22:23:00 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-7a221134-c422-4369-b650-24d81d3e557a" returned: 0 in 0.699s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-7a221134-c422-4369-b650-24d81d3e557a" released by "delete_volume" :: held 1.656s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created reservations ['81990586-6429-42f3-8b10-fa4848d69598', 'edbe577b-b036-4991-adea-e8f4d0b6a3df', '2841e59c-8a7c-4bf5-9c6c-c4186a40b75d', '0dafb196-bb7d-44c5-bc17-6f211e8ab17e'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:00 devstack sudo[114508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:00 devstack sudo[114508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:00 devstack sudo[114502]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 1073741824" returned: 0 in 1.003s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:00 devstack sudo[114511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 Jun 26 22:23:00 devstack sudo[114511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-0f1de8d6-0c45-4b1e-8e10-45c12e485368-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-0f1de8d6-0c45-4b1e-8e10-45c12e485368-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-0f1de8d6-0c45-4b1e-8e10-45c12e485368" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-0f1de8d6-0c45-4b1e-8e10-45c12e485368" acquired by "delete_volume" :: waited 0.022s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[50623abe-4fd0-4308-bacf-4859801fb25d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:00 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:01 devstack sudo[114513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 Jun 26 22:23:01 devstack sudo[114513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:01 devstack sudo[114508]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 1.050s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:01 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Deleted volume successfully. Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-1c9fa9a9-fd7a-4d88-bdac-c58f36cb7f87 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-7a221134-c422-4369-b650-24d81d3e557a-delete_volume" released by "delete_volume" :: held 2.977s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Flow 'volume_create_manager' (91758e81-4902-4914-a950-982238db1ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fdc3ae-150a-4678-aabd-efa2ff36915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fdc3ae-150a-4678-aabd-efa2ff36915c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1676190549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44693400-a8ae-4dc6-8d14-43712578e78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf8269f4846457d9c253f4414359881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=50bf90b0-843f-4a09-9fa4-8674d85ff1d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:01Z,use_quota=True,user_id='f42d0040fd254939841c7a22a2c50807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff47a21-0b38-455c-adeb-df3fe8e52ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ff47a21-0b38-455c-adeb-df3fe8e52ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98286902-2adb-419f-a14b-f3a179b4b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98286902-2adb-419f-a14b-f3a179b4b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44693400-a8ae-4dc6-8d14-43712578e78b', 'volume_name': 'volume-44693400-a8ae-4dc6-8d14-43712578e78b', 'volume_size': 1, 'snapshot_id': '50bf90b0-843f-4a09-9fa4-8674d85ff1d5'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362b496f-abd7-47d2-aeb3-54c7cd355aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (362b496f-abd7-47d2-aeb3-54c7cd355aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7985a38b-e437-41ed-ba9a-adc96cdfeb11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:01 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Volume 44693400-a8ae-4dc6-8d14-43712578e78b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44693400-a8ae-4dc6-8d14-43712578e78b', 'volume_size': 1, 'snapshot_id': '50bf90b0-843f-4a09-9fa4-8674d85ff1d5'} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:01 devstack sudo[114511]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9" returned: 0 in 1.042s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] <== create_volume: return (2107ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.068s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-quobyte-50bf90b0-843f-4a09-9fa4-8674d85ff1d5-44693400-a8ae-4dc6-8d14-43712578e78b" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-50bf90b0-843f-4a09-9fa4-8674d85ff1d5-44693400-a8ae-4dc6-8d14-43712578e78b" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Creating volume 44693400-a8ae-4dc6-8d14-43712578e78b from snapshot 50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-quobyte-44693400-a8ae-4dc6-8d14-43712578e78b" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Attempting download of d03d3650-e7f9-4d55-bc57-72a97e2e5d71 ((None, [{'url': 'file:///opt/stack/data/glance/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'metadata': {}}])) to volume da54334f-eef0-41df-ae77-abd7d06bc3b9. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-44693400-a8ae-4dc6-8d14-43712578e78b" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] snapshot: 50bf90b0-843f-4a09-9fa4-8674d85ff1d5, volume: 44693400-a8ae-4dc6-8d14-43712578e78b, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dfa190-6a06-4eb0-beb9-01bf240c1d44]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28eeb17-20d8-4fab-96a8-438ecab11554]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_bjrer4r0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:01 devstack sudo[114513]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368" returned: 0 in 1.014s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:01 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:01 devstack sudo[114520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 Jun 26 22:23:01 devstack sudo[114520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:01 devstack sudo[114521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_bjrer4r0 Jun 26 22:23:01 devstack sudo[114521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:01 devstack sudo[114522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368 Jun 26 22:23:01 devstack sudo[114522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:02 devstack sudo[114522]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-0f1de8d6-0c45-4b1e-8e10-45c12e485368" returned: 0 in 0.769s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-0f1de8d6-0c45-4b1e-8e10-45c12e485368" released by "delete_volume" :: held 1.849s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:02 devstack sudo[114521]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_bjrer4r0" returned: 0 in 0.906s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_bjrer4r0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:02 devstack sudo[114520]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5" returned: 0 in 0.965s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[2deb2071-f181-474d-ba8a-3c657d4938c3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created reservations ['d1a42176-272f-48bd-817a-a1600676f8ea', '5b710d57-d966-4d7d-b32a-3f44e26eafdf', '2a722086-a985-4b25-896a-2ec011995d6a', '92037eb5-68f6-4238-a986-d23fc0da6e05'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:02 devstack sudo[114533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_bjrer4r0 Jun 26 22:23:02 devstack sudo[114533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:02 devstack sudo[114534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 Jun 26 22:23:02 devstack sudo[114534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:02 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:02 devstack sudo[114537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:02 devstack sudo[114537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-7c6628d6-80c4-4ef1-be42-157c1fb453b1-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-7c6628d6-80c4-4ef1-be42-157c1fb453b1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-82618774-a255-4d5c-bec8-1b9b503e2435" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-82618774-a255-4d5c-bec8-1b9b503e2435" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-7c6628d6-80c4-4ef1-be42-157c1fb453b1" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-7c6628d6-80c4-4ef1-be42-157c1fb453b1" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Deleting offline snapshot 7c6628d6-80c4-4ef1-be42-157c1fb453b1 of volume 82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] snapshot_file for this snap is: volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd353d70-0d1e-46d3-8adc-1c01542f2198]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:03 devstack sudo[114539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 Jun 26 22:23:03 devstack sudo[114539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:03 devstack sudo[114533]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_bjrer4r0" returned: 1 in 1.054s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_bjrer4r0' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65b4d93-43cf-49e2-be7b-10fafc7f5568]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:03 devstack sudo[114537]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.879s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:03 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Deleted volume successfully. Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=134,cinder:UPDATE=208,cinder:INSERT=55,cinder:DELETE=22 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:23:03 devstack sudo[114534]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" returned: 0 in 1.144s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:03 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-de510e4c-c89e-44f2-99c3-5bb584a28092 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-0f1de8d6-0c45-4b1e-8e10-45c12e485368-delete_volume" released by "delete_volume" :: held 3.156s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:03 devstack sudo[114548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b Jun 26 22:23:03 devstack sudo[114548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:03 devstack sudo[114547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD Jun 26 22:23:03 devstack sudo[114547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:04 devstack sudo[114539]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1" returned: 0 in 1.072s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:04 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-82618774-a255-4d5c-bec8-1b9b503e2435(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:23:04 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[501f5178-6710-4b90-a37a-cfbad6da96c3]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:04 devstack sudo[114554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 Jun 26 22:23:04 devstack sudo[114554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:04 devstack sudo[114547]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD" returned: 0 in 1.032s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:04 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:04 devstack sudo[114561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD Jun 26 22:23:04 devstack sudo[114561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:06 devstack sudo[114554]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435" returned: 0 in 1.738s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:06 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 Jun 26 22:23:06 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:06 devstack sudo[114561]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD" returned: 1 in 1.541s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:23:06 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] d03d3650-e7f9-4d55-bc57-72a97e2e5d71 was raw, converting to raw {{(pid=93616) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 26 22:23:06 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:06 devstack sudo[114579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 Jun 26 22:23:06 devstack sudo[114579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:07 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1" returned: 0 in 1.526s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:07 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:07 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1 Jun 26 22:23:07 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:08 devstack sudo[114579]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9" returned: 0 in 1.965s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:08 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d03d3650-e7f9-4d55-bc57-72a97e2e5d71_1lamuodudevstack@QuobyteHD, size 0.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:23:08 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Converted 0.00 MB image at 0.00 MB/s Jun 26 22:23:08 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:08 devstack sudo[114589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 1G Jun 26 22:23:08 devstack sudo[114589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:09 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:09 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435.7c6628d6-80c4-4ef1-be42-157c1fb453b1" returned: 0 in 1.659s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-7c6628d6-80c4-4ef1-be42-157c1fb453b1" released by "_delete_snapshot" :: held 6.247s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-82618774-a255-4d5c-bec8-1b9b503e2435" released by "delete_snapshot" :: held 6.305s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:09 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created reservations ['2652f984-9400-4835-b4c7-3b75259dd501', '0efa2181-1357-44c6-b375-2365b187cf66', '02a992a6-5216-45fe-b5fe-6d84abc5b54e', '56ff2680-d4be-4674-8c69-db7e42198d6f'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:09 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Delete snapshot completed successfully. Jun 26 22:23:09 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa005835-9557-482e-a8c7-00d8a57e30ab tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-7c6628d6-80c4-4ef1-be42-157c1fb453b1-delete_snapshot" released by "delete_snapshot" :: held 6.797s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:10 devstack sudo[114589]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 1G" returned: 0 in 1.675s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84ebdff-5a57-4194-ac6c-595136873616]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:10 devstack sudo[114596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 Jun 26 22:23:10 devstack sudo[114596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:10 devstack sudo[114548]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b" returned: 0 in 6.815s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1dd99b-4d08-4a6c-bb76-d9c587f24d54]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-82618774-a255-4d5c-bec8-1b9b503e2435-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-82618774-a255-4d5c-bec8-1b9b503e2435-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "cinder-quobyte-82618774-a255-4d5c-bec8-1b9b503e2435" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:10 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-82618774-a255-4d5c-bec8-1b9b503e2435" acquired by "delete_volume" :: waited 0.020s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:10 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 Jun 26 22:23:10 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:11 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d31f52-4f0b-472b-b983-1bab8799d797]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:11 devstack sudo[114600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 Jun 26 22:23:11 devstack sudo[114600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:11 devstack sudo[114596]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9" returned: 0 in 1.315s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:11 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:11 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 Jun 26 22:23:11 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:12 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" returned: 0 in 1.409s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144, size 1024.00 MB, duration 6.82 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:23:12 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Converted 1024.00 MB image at 150.22 MB/s Jun 26 22:23:12 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b is being set with open permissions: ugo+rw Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:12 devstack sudo[114648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b Jun 26 22:23:12 devstack sudo[114648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:12 devstack sudo[114600]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435" returned: 0 in 1.259s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:12 devstack sudo[114650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435 Jun 26 22:23:12 devstack sudo[114650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:12 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9" returned: 1 in 1.285s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Downloaded image d03d3650-e7f9-4d55-bc57-72a97e2e5d71 ((None, [{'url': 'file:///opt/stack/data/glance/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'metadata': {}}])) to volume da54334f-eef0-41df-ae77-abd7d06bc3b9 successfully. {{(pid=93616) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Temporary image d03d3650-e7f9-4d55-bc57-72a97e2e5d71 for user 3a92b0d832e74ccc82ebf43f12fbce92 is deleted. {{(pid=93616) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.volume_utils [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Marking volume da54334f-eef0-41df-ae77-abd7d06bc3b9 as bootable. {{(pid=93616) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Copying metadata from image d03d3650-e7f9-4d55-bc57-72a97e2e5d71 to da54334f-eef0-41df-ae77-abd7d06bc3b9. {{(pid=93616) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Creating volume glance metadata for volume da54334f-eef0-41df-ae77-abd7d06bc3b9 backed by image d03d3650-e7f9-4d55-bc57-72a97e2e5d71 with: {'image_id': 'd03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e75c5c5c58430d536c9bf7e365baddb4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93616) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9888b4f1-e75c-4c94-b33b-d03e3a399e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da54334f-eef0-41df-ae77-abd7d06bc3b9', 'volume_size': 1, 'image_id': 'd03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e75c5c5c58430d536c9bf7e365baddb4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fc495f2672ee4595ae24ca5c5e006116', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '547d3079f469022eb6da36e540226010cf4f9a6e4eddd5ad816b8949b22ba8e8eb9d2fdc3cbbfef060dad5f606cad2c62e21f57f1a1695269926fa975d5388bd', 'id': 'd03d3650-e7f9-4d55-bc57-72a97e2e5d71', 'created_at': datetime.datetime(2026, 6, 26, 20, 22, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 26, 20, 22, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d03d3650-e7f9-4d55-bc57-72a97e2e5d71/file', 'properties': {}}, 'image_service': }' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030b0444-a837-47a9-82b6-3b9fdf66cd24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:12 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Volume volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 (da54334f-eef0-41df-ae77-abd7d06bc3b9): created successfully Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030b0444-a837-47a9-82b6-3b9fdf66cd24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:12 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Flow 'volume_create_manager' (1ebd88fb-35a9-42e0-8cd7-13282e51d32d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-62a65be5-5f51-4a43-aed6-579676eed7d0 tempest-VolumeImageDependencyTests-1998446767 None] Created volume successfully. Jun 26 22:23:13 devstack sudo[114648]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b" returned: 0 in 1.048s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-44693400-a8ae-4dc6-8d14-43712578e78b" released by "_copy_volume_from_snapshot" :: held 11.520s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-50bf90b0-843f-4a09-9fa4-8674d85ff1d5-44693400-a8ae-4dc6-8d14-43712578e78b" released by "_create_volume_from_snapshot" :: held 11.573s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.604s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:13 devstack sudo[114650]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-82618774-a255-4d5c-bec8-1b9b503e2435" returned: 0 in 0.955s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=159,cinder:UPDATE=201,cinder:INSERT=54,cinder:DELETE=17 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-quobyte-82618774-a255-4d5c-bec8-1b9b503e2435" released by "delete_volume" :: held 2.315s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7985a38b-e437-41ed-ba9a-adc96cdfeb11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44693400-a8ae-4dc6-8d14-43712578e78b', 'volume_size': 1, 'snapshot_id': '50bf90b0-843f-4a09-9fa4-8674d85ff1d5'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f975f0-7840-483f-8a20-dcc398eaadcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:13 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Volume volume-44693400-a8ae-4dc6-8d14-43712578e78b (44693400-a8ae-4dc6-8d14-43712578e78b): created successfully Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21f975f0-7840-483f-8a20-dcc398eaadcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Flow 'volume_create_manager' (91758e81-4902-4914-a950-982238db1ae8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:13 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-db0ddf8b-234a-4a2f-a8fb-dbf8dba35916 tempest-VolumeDependencyTests-1638096603 None] Created volume successfully. Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Created reservations ['c6980cfb-230a-4e47-af66-5f7ad065cafc', 'b26f8655-f961-44a0-902c-80c077bae45b', '6f7c883f-1a26-448d-b968-a8f2dc9bea64', 'b4d20980-c599-425d-a77e-bca5dbd1fa0a'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:13 devstack sudo[114657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:13 devstack sudo[114657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-50bf90b0-843f-4a09-9fa4-8674d85ff1d5-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Acquiring lock "cinder-da54334f-eef0-41df-ae77-abd7d06bc3b9-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-50bf90b0-843f-4a09-9fa4-8674d85ff1d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-quobyte-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:13 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Lock "cinder-da54334f-eef0-41df-ae77-abd7d06bc3b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" acquired by "delete_snapshot" :: waited 0.036s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-quobyte-50bf90b0-843f-4a09-9fa4-8674d85ff1d5" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-50bf90b0-843f-4a09-9fa4-8674d85ff1d5" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Deleting offline snapshot 50bf90b0-843f-4a09-9fa4-8674d85ff1d5 of volume f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] snapshot_file for this snap is: volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c2929c-cafd-4c05-adf3-c264caa74666]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Acquiring lock "cinder-quobyte-da54334f-eef0-41df-ae77-abd7d06bc3b9" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Lock "cinder-quobyte-da54334f-eef0-41df-ae77-abd7d06bc3b9" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6670be-33e8-4819-8ef8-87736bdff580]: (4, 'raw') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:14 devstack sudo[114659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 Jun 26 22:23:14 devstack sudo[114659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:14 devstack sudo[114657]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.888s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:14 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Deleted volume successfully. Jun 26 22:23:14 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458d5ea-e535-493c-8fcb-dc070f727438 tempest-CreateVolumesFromSnapshotTest-1546409867 None] Lock "cinder-82618774-a255-4d5c-bec8-1b9b503e2435-delete_volume" released by "delete_volume" :: held 3.521s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:14 devstack sudo[114661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 Jun 26 22:23:14 devstack sudo[114661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:15 devstack sudo[114659]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5" returned: 0 in 1.038s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:15 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:23:15 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c68f52-a67f-42fa-bd88-9a33696af2cd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:15 devstack sudo[114670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 Jun 26 22:23:15 devstack sudo[114670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:15 devstack sudo[114661]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9" returned: 0 in 1.143s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:15 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:15 devstack sudo[114672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 Jun 26 22:23:15 devstack sudo[114672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:16 devstack sudo[114670]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" returned: 0 in 1.148s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:16 devstack sudo[114672]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9" returned: 1 in 0.998s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9' failed. Not Retrying. {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 22:23:16 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:16 devstack sudo[114680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 Jun 26 22:23:16 devstack sudo[114680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:16 devstack sudo[114681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9 Jun 26 22:23:16 devstack sudo[114681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:17 devstack sudo[114681]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-da54334f-eef0-41df-ae77-abd7d06bc3b9" returned: 0 in 0.836s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Lock "cinder-quobyte-da54334f-eef0-41df-ae77-abd7d06bc3b9" released by "delete_volume" :: held 3.084s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Created reservations ['c5588a8a-4629-486a-8bc6-aa53f36e45ec', '8b7eeef8-86a0-4461-9da9-4f83ea90ffb4', 'a8d3a22c-7a4c-4001-835f-5ded37d4ab07', 'e5025be6-269f-4126-b34f-8db9fa068317'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:17 devstack sudo[114680]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5" returned: 0 in 0.983s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:17 devstack sudo[114689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5 Jun 26 22:23:17 devstack sudo[114689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:17 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:17 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:17 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:18 devstack sudo[114689]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144.50bf90b0-843f-4a09-9fa4-8674d85ff1d5" returned: 0 in 0.764s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-50bf90b0-843f-4a09-9fa4-8674d85ff1d5" released by "_delete_snapshot" :: held 4.111s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" released by "delete_snapshot" :: held 4.166s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:18 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.883s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Deleted volume successfully. Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Created reservations ['53d0e1c7-ba92-4241-8994-1fca468d49e5', '409c2b25-74a1-49ad-b6d3-ff89a8afb173', '0969ebff-e332-4169-9bf3-f653f7338b17', 'dee329ae-fe5a-4691-a835-f34cfed05d69'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7458c8f2-317d-47ff-891e-131aa98777ce tempest-VolumeImageDependencyTests-1998446767 None] Lock "cinder-da54334f-eef0-41df-ae77-abd7d06bc3b9-delete_volume" released by "delete_volume" :: held 4.338s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:18 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Delete snapshot completed successfully. Jun 26 22:23:18 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4575a25d-a1b7-4440-bb17-0bff0fdf5870 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-50bf90b0-843f-4a09-9fa4-8674d85ff1d5-delete_snapshot" released by "delete_snapshot" :: held 4.416s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Flow 'volume_create_manager' (45b54312-5792-409c-bf37-b1adda46cbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe48e21a-bf54-4bb5-bbf7-790af81dcf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe48e21a-bf54-4bb5-bbf7-790af81dcf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4def64-30ab-4f12-b53e-647ca0b93b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75293aa16204867b9a46604f61cb2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:19Z,use_quota=True,user_id='f1107853f0364233bc7b3ff278fe3a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca1dad1-f674-45d7-a9f0-8692326d32d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca1dad1-f674-45d7-a9f0-8692326d32d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8105a2d-71f8-43f0-a379-d7af5734196e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8105a2d-71f8-43f0-a379-d7af5734196e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c4def64-30ab-4f12-b53e-647ca0b93b9b', 'volume_name': 'volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956193b5-15bb-4ded-85df-6304d735c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956193b5-15bb-4ded-85df-6304d735c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f31c071-5728-484f-a324-05c23f3bc49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:19 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Volume 9c4def64-30ab-4f12-b53e-647ca0b93b9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b', 'volume_size': 1} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c4def64-30ab-4f12-b53e-647ca0b93b9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75293aa16204867b9a46604f61cb2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:19Z,use_quota=True,user_id='f1107853f0364233bc7b3ff278fe3a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Creating volume 9c4def64-30ab-4f12-b53e-647ca0b93b9b {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:23:19 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-f94ef4a6-5283-41ba-bf56-d92f8f3f7144-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:19 devstack sudo[114695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b 1073741824 Jun 26 22:23:19 devstack sudo[114695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-f94ef4a6-5283-41ba-bf56-d92f8f3f7144-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-quobyte-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24a9189-9078-4456-9d2b-10f125b36a4b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:19 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:19 devstack sudo[114697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 Jun 26 22:23:19 devstack sudo[114697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:20 devstack sudo[114697]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" returned: 0 in 0.968s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:20 devstack sudo[114695]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b 1073741824" returned: 0 in 1.220s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:20 devstack sudo[114705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144 Jun 26 22:23:20 devstack sudo[114705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:20 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:20 devstack sudo[114707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b Jun 26 22:23:20 devstack sudo[114707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:21 devstack sudo[114705]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" returned: 0 in 0.748s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-f94ef4a6-5283-41ba-bf56-d92f8f3f7144" released by "delete_volume" :: held 1.833s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Created reservations ['5b115352-4b43-4e74-972c-5726d6550755', '6a878639-8d58-4719-9565-b6a83a604426', 'cab7da2d-15ca-4c48-9abd-f70a73f0b15d', '6579c304-7267-41a0-abbb-8ff56e5feb27'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:21 devstack sudo[114707]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b" returned: 0 in 0.754s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f31c071-5728-484f-a324-05c23f3bc49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a717e1-288b-4094-89a0-b875bbfbe6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:21 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Volume volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b (9c4def64-30ab-4f12-b53e-647ca0b93b9b): created successfully Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8a717e1-288b-4094-89a0-b875bbfbe6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Flow 'volume_create_manager' (45b54312-5792-409c-bf37-b1adda46cbbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:21 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-45fdbcba-3ac8-4141-8ac5-b9c3aad50c0e tempest-CinderUnicodeTest-1102377650 None] Created volume successfully. Jun 26 22:23:21 devstack sudo[114712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:21 devstack sudo[114712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-44693400-a8ae-4dc6-8d14-43712578e78b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-44693400-a8ae-4dc6-8d14-43712578e78b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "cinder-quobyte-44693400-a8ae-4dc6-8d14-43712578e78b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-44693400-a8ae-4dc6-8d14-43712578e78b" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0619d9-74ee-49f5-944c-8ad9631813f4]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:21 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:21 devstack sudo[114714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b Jun 26 22:23:21 devstack sudo[114714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:22 devstack sudo[114712]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.779s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:22 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:22 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Deleted volume successfully. Jun 26 22:23:22 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-bb703270-4ca9-42ba-a1d3-d4837b4885e4 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-f94ef4a6-5283-41ba-bf56-d92f8f3f7144-delete_volume" released by "delete_volume" :: held 2.904s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:22 devstack sudo[114714]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b" returned: 0 in 1.036s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:22 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:22 devstack sudo[114722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b Jun 26 22:23:22 devstack sudo[114722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Flow 'volume_create_manager' (e66d306d-e887-42cf-a6a0-a96cecd71625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a887b15a-8ebf-46f9-9f7d-1760eefabbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a887b15a-8ebf-46f9-9f7d-1760eefabbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-458457881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf0d657-77b8-43d6-bca6-cbec08e94744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75293aa16204867b9a46604f61cb2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:23Z,use_quota=True,user_id='f1107853f0364233bc7b3ff278fe3a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e19af5-3bf1-48c2-bb07-614677f6027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45e19af5-3bf1-48c2-bb07-614677f6027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe8045e-a95b-449a-8404-b0f5350f3b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fe8045e-a95b-449a-8404-b0f5350f3b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf0d657-77b8-43d6-bca6-cbec08e94744', 'volume_name': 'volume-ccf0d657-77b8-43d6-bca6-cbec08e94744', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21e75bb-a032-426a-85b4-b319e15c0dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c21e75bb-a032-426a-85b4-b319e15c0dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6205533d-a40c-4343-bc3d-a3d62d442f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:23 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Volume ccf0d657-77b8-43d6-bca6-cbec08e94744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf0d657-77b8-43d6-bca6-cbec08e94744', 'volume_size': 1} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-458457881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf0d657-77b8-43d6-bca6-cbec08e94744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d75293aa16204867b9a46604f61cb2c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:23Z,use_quota=True,user_id='f1107853f0364233bc7b3ff278fe3a6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Creating volume ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:23:23 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:23 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 1073741824 Jun 26 22:23:23 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:23 devstack sudo[114722]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-44693400-a8ae-4dc6-8d14-43712578e78b" returned: 0 in 0.784s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-quobyte-44693400-a8ae-4dc6-8d14-43712578e78b" released by "delete_volume" :: held 1.906s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Created reservations ['481af934-29df-45b9-af3e-606a528e7cd0', '47bd145f-bfcf-4387-a729-976f1b26db11', '2b224ede-f2ab-48a4-a12c-8a5d92037b6f', '5dc0224a-d58b-4604-9315-af80bfc1d4db'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:23 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:23 devstack sudo[114727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:23 devstack sudo[114727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:24 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 1073741824" returned: 0 in 1.058s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:24 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 Jun 26 22:23:24 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:24 devstack sudo[114727]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:24 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.777s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:24 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:24 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Deleted volume successfully. Jun 26 22:23:24 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-7cbdc649-cb90-46ba-b855-309fa3ba19f8 tempest-VolumeDependencyTests-1638096603 None] Lock "cinder-44693400-a8ae-4dc6-8d14-43712578e78b-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:25 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744" returned: 0 in 0.771s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:25 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] <== create_volume: return (1901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:23:25 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6205533d-a40c-4343-bc3d-a3d62d442f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf0d657-77b8-43d6-bca6-cbec08e94744', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3493445c-36b4-4d98-a1a0-a071e88b6abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:25 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Volume volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 (ccf0d657-77b8-43d6-bca6-cbec08e94744): created successfully Jun 26 22:23:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3493445c-36b4-4d98-a1a0-a071e88b6abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:25 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Flow 'volume_create_manager' (e66d306d-e887-42cf-a6a0-a96cecd71625) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:25 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-c40b2397-fd4c-4330-8100-d22862f3540e tempest-CinderUnicodeTest-1102377650 None] Created volume successfully. Jun 26 22:23:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:26 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Creating offline snapshot ff82edd1-6df0-4760-93b7-f4e2e354b6d6 of volume ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:23:26 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c8b108-c730-41d3-9a6c-bb1269e4c81c]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:26 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:26 devstack sudo[114740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 Jun 26 22:23:26 devstack sudo[114740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:27 devstack sudo[114740]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744" returned: 0 in 0.804s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:27 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:27 devstack sudo[114745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 1G Jun 26 22:23:27 devstack sudo[114745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:28 devstack sudo[114745]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 1G" returned: 0 in 0.970s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:28 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:28 devstack sudo[114751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 Jun 26 22:23:28 devstack sudo[114751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Flow 'volume_create_manager' (a88d052d-683a-4b44-889e-39d72d76081f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c29e8ec-ffe3-47d8-94e6-5cf9a0b70acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c29e8ec-ffe3-47d8-94e6-5cf9a0b70acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1040469909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5919b265-b3db-4054-b6fc-ca7e416c0928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a54a320db9f40eca5ca837587e3f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:29Z,use_quota=True,user_id='0ca635363dc8414bb40a75f9b46ee548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfc7f93-bad2-4b47-9b23-9c47b3bdadc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bfc7f93-bad2-4b47-9b23-9c47b3bdadc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a71b4f6-0f95-4f77-ba25-680225dfb685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a71b4f6-0f95-4f77-ba25-680225dfb685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5919b265-b3db-4054-b6fc-ca7e416c0928', 'volume_name': 'volume-5919b265-b3db-4054-b6fc-ca7e416c0928', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d71b9a-e552-48c9-930f-a80f7f509d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:29 devstack sudo[114751]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4d71b9a-e552-48c9-930f-a80f7f509d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e4617c-df7b-4f75-805c-3d7f66246bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:29 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Volume 5919b265-b3db-4054-b6fc-ca7e416c0928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5919b265-b3db-4054-b6fc-ca7e416c0928', 'volume_size': 1} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6" returned: 0 in 0.763s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:29 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 is being set with open permissions: ugo+rw Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:29 devstack sudo[114757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 Jun 26 22:23:29 devstack sudo[114757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:29 devstack sudo[114757]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6" returned: 0 in 0.653s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:29 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:29 devstack sudo[114760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.info Jun 26 22:23:29 devstack sudo[114760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:30 devstack sudo[114760]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.info" returned: 0 in 0.669s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:30 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.info is being set with open permissions: ugo+rw Jun 26 22:23:30 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:30 devstack sudo[114763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.info Jun 26 22:23:30 devstack sudo[114763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:31 devstack sudo[114763]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.info" returned: 0 in 0.655s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.599s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.030s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1040469909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5919b265-b3db-4054-b6fc-ca7e416c0928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a54a320db9f40eca5ca837587e3f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:29Z,use_quota=True,user_id='0ca635363dc8414bb40a75f9b46ee548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)}" {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Creating volume 5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:23:31 devstack cinder-volume[93616]: INFO cinder.volume.drivers.remotefs [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] casted to osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 1073741824 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:31 devstack sudo[114766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 1073741824 Jun 26 22:23:31 devstack sudo[114766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:31 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-2c7ce4a6-932e-4e52-82de-474ec84a8039 tempest-CinderUnicodeTest-1102377650 None] Create snapshot completed successfully Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "cinder-ff82edd1-6df0-4760-93b7-f4e2e354b6d6-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-ff82edd1-6df0-4760-93b7-f4e2e354b6d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "cinder-quobyte-ccf0d657-77b8-43d6-bca6-cbec08e94744" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-ccf0d657-77b8-43d6-bca6-cbec08e94744" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "cinder-quobyte-ff82edd1-6df0-4760-93b7-f4e2e354b6d6" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-ff82edd1-6df0-4760-93b7-f4e2e354b6d6" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:31 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Deleting offline snapshot ff82edd1-6df0-4760-93b7-f4e2e354b6d6 of volume ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] snapshot_file for this snap is: volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[3364e45e-bcd4-4803-8b28-36caed1f7be0]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:32 devstack sudo[114766]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 1073741824" returned: 0 in 0.875s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:32 devstack sudo[114772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 Jun 26 22:23:32 devstack sudo[114772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:32 devstack sudo[114773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 Jun 26 22:23:32 devstack sudo[114773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:32 devstack sudo[114773]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928" returned: 0 in 0.661s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'} {{(pid=93616) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:32 devstack sudo[114772]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6" returned: 0 in 0.786s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ccf0d657-77b8-43d6-bca6-cbec08e94744(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5e4617c-df7b-4f75-805c-3d7f66246bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5919b265-b3db-4054-b6fc-ca7e416c0928', 'volume_size': 1}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d229ac-8b60-4014-8cc1-0208a57e4d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48cf263-a389-4093-bfd8-36844503019e]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:32 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Volume volume-5919b265-b3db-4054-b6fc-ca7e416c0928 (5919b265-b3db-4054-b6fc-ca7e416c0928): created successfully Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40d229ac-8b60-4014-8cc1-0208a57e4d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:32 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Flow 'volume_create_manager' (a88d052d-683a-4b44-889e-39d72d76081f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:32 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-ce56c7e0-77c1-472f-b294-e196e1acf861 tempest-SnapshotDependencyTests-1005947824 None] Created volume successfully. Jun 26 22:23:32 devstack sudo[114780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 Jun 26 22:23:32 devstack sudo[114780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:33 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Creating offline snapshot fc7f915f-e95f-4bb4-9609-d1ea11b75c41 of volume 5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 26 22:23:33 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7c0a23-de4f-435f-8379-feabf84db8ca]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:33 devstack sudo[114780]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744" returned: 0 in 0.771s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:33 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 Jun 26 22:23:33 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:33 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:33 devstack sudo[114788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 Jun 26 22:23:33 devstack sudo[114788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:34 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928" returned: 0 in 0.762s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 1G {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:34 devstack sudo[114796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 1G Jun 26 22:23:34 devstack sudo[114796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:34 devstack sudo[114788]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6" returned: 0 in 0.724s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:34 devstack sudo[114798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6 Jun 26 22:23:34 devstack sudo[114798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:34 devstack sudo[114798]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:34 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744.ff82edd1-6df0-4760-93b7-f4e2e354b6d6" returned: 0 in 0.635s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-ff82edd1-6df0-4760-93b7-f4e2e354b6d6" released by "_delete_snapshot" :: held 3.052s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-ccf0d657-77b8-43d6-bca6-cbec08e94744" released by "delete_snapshot" :: held 3.145s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:35 devstack sudo[114796]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 1G" returned: 0 in 0.831s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5919b265-b3db-4054-b6fc-ca7e416c0928 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Created reservations ['52dd05a1-fee5-4539-8602-2355136691d1', '636ed5f7-42d6-4dc3-bc22-04eaf19a4291', '29b28bcb-483f-41fb-a04d-0605b32bfe7b', '5bf9e183-5a22-474f-b17d-7df99d3aefc1'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:35 devstack sudo[114805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5919b265-b3db-4054-b6fc-ca7e416c0928 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 Jun 26 22:23:35 devstack sudo[114805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:35 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Delete snapshot completed successfully. Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-52fa7d13-4755-4ccf-b3a1-13886f145c9a tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-ff82edd1-6df0-4760-93b7-f4e2e354b6d6-delete_snapshot" released by "delete_snapshot" :: held 3.288s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:35 devstack sudo[114805]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5919b265-b3db-4054-b6fc-ca7e416c0928 -F qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41" returned: 0 in 0.697s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:35 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 is being set with open permissions: ugo+rw Jun 26 22:23:35 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:35 devstack sudo[114810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 Jun 26 22:23:35 devstack sudo[114810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "cinder-ccf0d657-77b8-43d6-bca6-cbec08e94744-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-ccf0d657-77b8-43d6-bca6-cbec08e94744-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "cinder-quobyte-ccf0d657-77b8-43d6-bca6-cbec08e94744" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-ccf0d657-77b8-43d6-bca6-cbec08e94744" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[e985f7cc-8a11-4ac8-aaf6-5f6104653776]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:36 devstack sudo[114812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 Jun 26 22:23:36 devstack sudo[114812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:36 devstack sudo[114810]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41" returned: 0 in 0.673s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:36 devstack sudo[114815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.info Jun 26 22:23:36 devstack sudo[114815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:36 devstack sudo[114812]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744" returned: 0 in 0.744s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:36 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:37 devstack sudo[114820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744 Jun 26 22:23:37 devstack sudo[114820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:37 devstack sudo[114815]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.info" returned: 0 in 0.655s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:37 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.info is being set with open permissions: ugo+rw Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.info {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:37 devstack sudo[114823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.info Jun 26 22:23:37 devstack sudo[114823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:37 devstack sudo[114820]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-ccf0d657-77b8-43d6-bca6-cbec08e94744" returned: 0 in 0.639s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-ccf0d657-77b8-43d6-bca6-cbec08e94744" released by "delete_volume" :: held 1.446s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Created reservations ['aeca0ca9-a7f6-4395-86d3-9cefa11d0bb9', 'ea7fafad-181a-48eb-9f10-bdfc3a83d864', '9053634b-9707-4b11-9420-6f14534c3b37', 'e54a6222-36db-440a-97fc-a825cab29341'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:37 devstack sudo[114823]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.info" returned: 0 in 0.638s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:37 devstack sudo[114827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:37 devstack sudo[114827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:37 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.349s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:37 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-94e720c1-97e0-4b1a-8f03-dc4fbd23eb53 tempest-SnapshotDependencyTests-1005947824 None] Create snapshot completed successfully Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "cinder-9c4def64-30ab-4f12-b53e-647ca0b93b9b-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-9c4def64-30ab-4f12-b53e-647ca0b93b9b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "cinder-quobyte-9c4def64-30ab-4f12-b53e-647ca0b93b9b" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:38 devstack sudo[114827]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.666s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-9c4def64-30ab-4f12-b53e-647ca0b93b9b" acquired by "delete_volume" :: waited 0.023s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:38 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Deleted volume successfully. Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b866d3cd-c5d0-4dc0-8a3f-a17f356072fb]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:38 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-f73b5dac-4941-41b1-b6d8-d25b0748844c tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-ccf0d657-77b8-43d6-bca6-cbec08e94744-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:38 devstack sudo[114830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b Jun 26 22:23:38 devstack sudo[114830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93616) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 26 22:23:39 devstack sudo[114830]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b" returned: 0 in 0.818s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:39 devstack sudo[114835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b Jun 26 22:23:39 devstack sudo[114835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Flow 'volume_create_manager' (de5638d9-2af6-477f-975a-a46a205ba9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f1d548-d256-45b5-901b-91a844b69852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16f1d548-d256-45b5-901b-91a844b69852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-26T20:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221d1604-3ce8-443a-8f9d-2cd72f91cca0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a54a320db9f40eca5ca837587e3f5e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-26T20:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fc7f915f-e95f-4bb4-9609-d1ea11b75c41,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-26T20:23:39Z,use_quota=True,user_id='0ca635363dc8414bb40a75f9b46ee548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5e6fca2e-e30a-4203-af90-0f955309ab0e),volume_type_id=5e6fca2e-e30a-4203-af90-0f955309ab0e)' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8505d9-7d0c-468a-92a4-eb90dda29bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8505d9-7d0c-468a-92a4-eb90dda29bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e604fc-5c17-4567-ab51-51f3d99825d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e604fc-5c17-4567-ab51-51f3d99825d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '221d1604-3ce8-443a-8f9d-2cd72f91cca0', 'volume_name': 'volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0', 'volume_size': 1, 'snapshot_id': 'fc7f915f-e95f-4bb4-9609-d1ea11b75c41'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bb9c1c-f192-4165-8d4c-7bf7ef9c6931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27bb9c1c-f192-4165-8d4c-7bf7ef9c6931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7e6a42-7c9f-4563-a7ea-b9e8404c9bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:39 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Volume 221d1604-3ce8-443a-8f9d-2cd72f91cca0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0', 'volume_size': 1, 'snapshot_id': 'fc7f915f-e95f-4bb4-9609-d1ea11b75c41'} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-quobyte-fc7f915f-e95f-4bb4-9609-d1ea11b75c41-221d1604-3ce8-443a-8f9d-2cd72f91cca0" by "_create_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-fc7f915f-e95f-4bb4-9609-d1ea11b75c41-221d1604-3ce8-443a-8f9d-2cd72f91cca0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Creating volume 221d1604-3ce8-443a-8f9d-2cd72f91cca0 from snapshot fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Selected osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919 as target Quobyte volume. {{(pid=93616) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-quobyte-221d1604-3ce8-443a-8f9d-2cd72f91cca0" by "_copy_volume_from_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-221d1604-3ce8-443a-8f9d-2cd72f91cca0" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] snapshot: fc7f915f-e95f-4bb4-9609-d1ea11b75c41, volume: 221d1604-3ce8-443a-8f9d-2cd72f91cca0, {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4622815-f776-41aa-8414-02b4b6344f5d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:39 devstack sudo[114837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 Jun 26 22:23:39 devstack sudo[114837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:39 devstack sudo[114835]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-9c4def64-30ab-4f12-b53e-647ca0b93b9b" returned: 0 in 0.658s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:39 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-quobyte-9c4def64-30ab-4f12-b53e-647ca0b93b9b" released by "delete_volume" :: held 1.526s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Created reservations ['26ec5798-4ca8-4bdd-9ef8-4837e0cf875a', '86a34610-d191-4d53-b7ba-cacad70d539d', 'e834ac6f-e718-473f-a80b-3ca0e9b1b42c', 'a76cbe2c-8f49-4d2f-b01b-a34dc17036de'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:40 devstack sudo[114840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:40 devstack sudo[114840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:40 devstack sudo[114837]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41" returned: 0 in 0.793s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5919b265-b3db-4054-b6fc-ca7e416c0928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Creating direct copy from snapshot {{(pid=93616) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8c17db-0ca8-497e-a2b9-ff392eb11b3a]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:40 devstack sudo[114845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 Jun 26 22:23:40 devstack sudo[114845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:40 devstack sudo[114840]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.655s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:40 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Deleted volume successfully. Jun 26 22:23:40 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-d9d6e5d1-4357-479b-a4bd-1396806ad198 tempest-CinderUnicodeTest-1102377650 None] Lock "cinder-9c4def64-30ab-4f12-b53e-647ca0b93b9b-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:41 devstack sudo[114845]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928" returned: 0 in 0.821s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:41 devstack cinder-volume[93616]: DEBUG cinder.utils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Path /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 not found in is_blk_device check {{(pid=93616) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 26 22:23:41 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:41 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 Jun 26 22:23:41 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:45 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0" returned: 0 in 4.731s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:45 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[09483e1d-f50b-4ea6-bce0-7676af98c23b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:45 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:46 devstack sudo[114872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 Jun 26 22:23:46 devstack sudo[114872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:46 devstack sudo[114874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:46 devstack sudo[114874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:46 devstack sudo[114872]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928" returned: 0 in 0.954s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG cinder.image.image_utils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Image conversion details: src /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928, size 1024.00 MB, duration 4.73 sec, destination /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 {{(pid=93616) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 26 22:23:46 devstack cinder-volume[93616]: INFO cinder.image.image_utils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Converted 1024.00 MB image at 216.39 MB/s Jun 26 22:23:46 devstack cinder-volume[93616]: WARNING cinder.volume.drivers.remotefs [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 is being set with open permissions: ugo+rw Jun 26 22:23:46 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:46 devstack sudo[114879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 Jun 26 22:23:46 devstack sudo[114879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:47 devstack sudo[114874]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.677s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG oslo_service.periodic_task [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] Running periodic task VolumeManager._thread_info {{(pid=93616) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread count: 28 {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-70f11f06-6e1c-4238-963f-e4cfd218e717 None None] thread info: [<_MainThread(MainThread, started 134681685758080)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93616) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 26 22:23:47 devstack sudo[114879]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0" returned: 0 in 0.634s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-221d1604-3ce8-443a-8f9d-2cd72f91cca0" released by "_copy_volume_from_snapshot" :: held 8.048s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-fc7f915f-e95f-4bb4-9609-d1ea11b75c41-221d1604-3ce8-443a-8f9d-2cd72f91cca0" released by "_create_volume_from_snapshot" :: held 8.083s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.102s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c7e6a42-7c9f-4563-a7ea-b9e8404c9bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0', 'volume_size': 1, 'snapshot_id': 'fc7f915f-e95f-4bb4-9609-d1ea11b75c41'}' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743a3bfd-3383-4378-93df-aa5d0eefafbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 26 22:23:47 devstack cinder-volume[93616]: INFO cinder.volume.flows.manager.create_volume [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Volume volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 (221d1604-3ce8-443a-8f9d-2cd72f91cca0): created successfully Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (743a3bfd-3383-4378-93df-aa5d0eefafbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93616) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 26 22:23:47 devstack cinder-volume[93616]: DEBUG cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Flow 'volume_create_manager' (de5638d9-2af6-477f-975a-a46a205ba9f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93616) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 26 22:23:47 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-aa1071d8-ee3b-49ed-8b1c-314f18536499 tempest-SnapshotDependencyTests-1005947824 None] Created volume successfully. Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-fc7f915f-e95f-4bb4-9609-d1ea11b75c41-delete_snapshot" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-fc7f915f-e95f-4bb4-9609-d1ea11b75c41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-quobyte-5919b265-b3db-4054-b6fc-ca7e416c0928" by "delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-5919b265-b3db-4054-b6fc-ca7e416c0928" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-quobyte-fc7f915f-e95f-4bb4-9609-d1ea11b75c41" by "_delete_snapshot" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-fc7f915f-e95f-4bb4-9609-d1ea11b75c41" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Deleting offline snapshot fc7f915f-e95f-4bb4-9609-d1ea11b75c41 of volume 5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] snapshot_file for this snap is: volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b9fa3c-00a1-481e-886d-61bbd0ee7c31]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:48 devstack sudo[114883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 Jun 26 22:23:48 devstack sudo[114883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:48 devstack sudo[114883]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41" returned: 0 in 0.778s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.remotefs [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5919b265-b3db-4054-b6fc-ca7e416c0928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93616) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7cb825-e2e7-48be-958b-163f064a4c9b]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:48 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:49 devstack sudo[114888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 Jun 26 22:23:49 devstack sudo[114888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:49 devstack sudo[114888]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928" returned: 0 in 0.761s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:49 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:49 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 Jun 26 22:23:49 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:50 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41" returned: 0 in 0.727s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:50 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:50 devstack sudo[114898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41 Jun 26 22:23:50 devstack sudo[114898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:51 devstack sudo[114898]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:51 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928.fc7f915f-e95f-4bb4-9609-d1ea11b75c41" returned: 0 in 0.662s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-fc7f915f-e95f-4bb4-9609-d1ea11b75c41" released by "_delete_snapshot" :: held 3.033s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-5919b265-b3db-4054-b6fc-ca7e416c0928" released by "delete_snapshot" :: held 3.057s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:51 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Created reservations ['34d665b7-07e9-4f5e-b9a8-e2d87f7322bb', 'c77e4b90-4ac0-4cc6-a308-6aecf1fe446a', '8a844018-4ab6-4cdb-86ad-cdd498f9b1de', 'b31760d3-3fc9-48ff-90c4-93b4e509cc3b'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:51 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Delete snapshot completed successfully. Jun 26 22:23:51 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-a1c9e692-109d-4806-947c-c17e16cd9fb2 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-fc7f915f-e95f-4bb4-9609-d1ea11b75c41-delete_snapshot" released by "delete_snapshot" :: held 3.196s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-5919b265-b3db-4054-b6fc-ca7e416c0928-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-5919b265-b3db-4054-b6fc-ca7e416c0928-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-quobyte-5919b265-b3db-4054-b6fc-ca7e416c0928" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:52 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-5919b265-b3db-4054-b6fc-ca7e416c0928" acquired by "delete_volume" :: waited 0.013s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:52 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa37ba02-5e30-42ea-b49a-c0dadfbb400d]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:52 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:52 devstack sudo[114901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 Jun 26 22:23:52 devstack sudo[114901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:53 devstack sudo[114901]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928" returned: 0 in 0.751s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:53 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928 Jun 26 22:23:53 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:53 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-5919b265-b3db-4054-b6fc-ca7e416c0928" returned: 0 in 0.645s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-5919b265-b3db-4054-b6fc-ca7e416c0928" released by "delete_volume" :: held 1.450s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Created reservations ['51701135-ba88-4dbe-a41c-374c02deeb2a', 'dbaa765f-946f-41cd-bbce-2336ec69eb1a', '596f2504-ceeb-4ca3-a955-90a09b1e369d', '481e0634-61cc-4041-8e5c-cf5b8e60c480'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:53 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:53 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:53 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-221d1604-3ce8-443a-8f9d-2cd72f91cca0-delete_volume" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-221d1604-3ce8-443a-8f9d-2cd72f91cca0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:54 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.649s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:54 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Deleted volume successfully. Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "cinder-quobyte-221d1604-3ce8-443a-8f9d-2cd72f91cca0" by "delete_volume" {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-4e0b7697-f0f2-461e-97ea-b2fcba857afb tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-5919b265-b3db-4054-b6fc-ca7e416c0928-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-221d1604-3ce8-443a-8f9d-2cd72f91cca0" acquired by "delete_volume" :: waited 0.017s {{(pid=93616) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG oslo.privsep.daemon [-] privsep: reply[032d4ca4-d577-455d-836c-1afeeacd28cd]: (4, 'qcow2') {{(pid=94904) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 26 22:23:54 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:54 devstack sudo[114913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 Jun 26 22:23:54 devstack sudo[114913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:55 devstack sudo[114913]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0" returned: 0 in 0.760s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:55 devstack sudo[114919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0 Jun 26 22:23:55 devstack sudo[114919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:55 devstack sudo[114919]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:55 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda/volume-221d1604-3ce8-443a-8f9d-2cd72f91cca0" returned: 0 in 0.624s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-quobyte-221d1604-3ce8-443a-8f9d-2cd72f91cca0" released by "delete_volume" :: held 1.424s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG cinder.quota [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Created reservations ['09df19cf-6d64-49b2-a727-e517e16de2c1', '307ca67b-3de1-4539-a487-7638eb6c08dc', '3d5a7a02-d11e-47c5-ae91-2572176774b1', '163c79cd-e1a7-45d2-bc64-a73f039065f8'] {{(pid=93616) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919': None} {{(pid=93616) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG cinder.volume.drivers.quobyte [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7e447635-c0b3-4899-801f-0174ddbcd919'] {{(pid=93616) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.lockutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93616) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 22:23:56 devstack sudo[114922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda Jun 26 22:23:56 devstack sudo[114922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 26 22:23:56 devstack sudo[114922]: pam_unix(sudo:session): session closed for user root Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG oslo_concurrency.processutils [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/43073f2d6d5beb437a2720a4a70abfda" returned: 0 in 0.678s {{(pid=93616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG cinder.manager [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Notifying Schedulers of capabilities ... {{(pid=93616) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 26 22:23:56 devstack cinder-volume[93616]: INFO cinder.volume.manager [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Deleted volume successfully. Jun 26 22:23:56 devstack cinder-volume[93616]: DEBUG cinder.coordination [None req-dde73370-a52f-4f3f-8a08-744b0f49b503 tempest-SnapshotDependencyTests-1005947824 None] Lock "cinder-221d1604-3ce8-443a-8f9d-2cd72f91cca0-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=93616) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 26 22:24:06 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:INSERT=30,cinder:DELETE=6,cinder:UPDATE=101,cinder:SELECT=64 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 26 22:24:06 devstack cinder-volume[93616]: DEBUG dbcounter [-] [93616] Writing DB stats cinder:SELECT=91,cinder:INSERT=23,cinder:UPDATE=99,cinder:DELETE=9 {{(pid=93616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}